G2 import goes at the beginning again and again

luc7v

Joined: 2010-11-05
Posts: 61
Posted: Tue, 2010-12-21 13:45

I'm trying to import G2.3.1 in G3.

After the import of the users (2450), it imported 10 albums (first level, I have 3 levels), then it goes at the beginning, importing users again. And so on, again and again.

Please help!

 
luc7v

Joined: 2010-11-05
Posts: 61
Posted: Tue, 2010-12-21 14:52

Now I have 39 albums imported (at every try a few more), so it's not about levels.

I turned error reporting on and it stops with this error on status (center of the screen):

unserialize() [function.unserialize]: Error at offset 65530 of 65535 bytes

How can I know what's wrong?

 
nemo2010

Joined: 2006-02-03
Posts: 84
Posted: Tue, 2010-12-21 21:55

I had problems with large images (20MB-30MB), one of the discrepancy I noticed was a total count of items present by G2 and the import tool. Perhaps it was trying to migrate an album/picture that didn't exist.
It would be nice to have a detailed log for the G2 import tool, including all items enumerated, processed, accessed, migrated, etc... It'd help me a lot.
Check the error_log on the server, it may reveal more info, I wish I could help more.

 
luc7v

Joined: 2010-11-05
Posts: 61
Posted: Tue, 2010-12-21 22:23

Because import of users was done, in helpers/g2_import_task.php at line 110 I replaced

case "users":

with

case "usersX":

This skips the step and... surprise!... the error is gone, the import goes on! I think it will be done in 2-3 days.

Can anyone tell me is this will have bad side effects?

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7985
Posted: Sat, 2010-12-25 23:36

Oh wow, you have so many users that the code we use to keep track of them is falling over! I don't think you want to do the import without importing your users -- your imported files will all have the wrong ownership. I created a task to work on this: https://sourceforge.net/apps/trac/gallery/ticket/1554 hopefully I'll have something in for 3.0.1 which resolves this. You probably want to hold off until then, sorry.
---
Problems? Check gallery3/var/logs
file a bug/feature ticket | upgrade to the latest code! | hacking G3? join us on IRC!

 
luc7v

Joined: 2010-11-05
Posts: 61
Posted: Sun, 2010-12-26 00:02

The problem seems to be at status update.

In g2_import_task.php , at line 81, I let only

while (!$task->done) {

and it's done over night.

About so many users, I have two suggestions:
- user manager needs pagination
- a feature to automatically delete inactive users for a year or so

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7985
Posted: Sun, 2010-12-26 08:08

Ah yeah that works -- that means that it imports all users in a single pass. This is great unless you're on a shared system in which case it will probably get you in trouble :-)

Please file tickets for the issues you see with too many users in the admin pages and I'll fix them when I can!
---
Problems? Check gallery3/var/logs
file a bug/feature ticket | upgrade to the latest code! | hacking G3? join us on IRC!

 
reshm4

Joined: 2011-10-22
Posts: 1
Posted: Sat, 2011-10-22 16:59
bharat wrote:
Ah yeah that works -- that means that it imports all users in a single pass. This is great unless you're on a shared system in which case it will probably get you in trouble :-)

Please file tickets for the issues you see with too many users in the admin pages and I'll fix them when I can!
---
Problems? Check gallery3/var/logs
file a bug/feature ticket | upgrade to the latest code! | hacking G3? join us on IRC!

Thanks for the info,

Resh