G3 Beta 1 - Import from Gallery 2.3 stuck

hleroy

Joined: 2005-02-15
Posts: 10
Posted: Sun, 2009-06-14 09:25

Hello,

I have started importing my Gallery 2.3 photos into Gallery 3 beta 1.

I'm stuck half way : Importing photos (9927 of 19894)

This is what I get in var/logs. I don't know how to help from here. Let me know if I can provide more details.

Hervé

2009-06-14 11:09:57 +02:00 --- error: @todo G2_FUNCTION_FAILED in /var/www/www.serialphotographer.com/gallery3/modules/g2_import/helpers/g2_import.php at line 757:
#0 /var/www/www.serialphotographer.com/gallery3/modules/g2_import/helpers/g2_import.php(385): g2(Array)
#1 /var/www/www.serialphotographer.com/gallery3/modules/g2_import/helpers/g2_import_task.php(126): g2_import_Core::import_item(Array)
#2 [internal function]: g2_import_task_Core::import(Object(Task_Model))
#3 /var/www/www.serialphotographer.com/gallery3/modules/gallery/helpers/task.php(78): call_user_func_array('g2_import_task:...', Array)
#4 /var/www/www.serialphotographer.com/gallery3/modules/gallery/controllers/admin_maintenance.php(140): task_Core::run('1')
#5 [internal function]: Admin_Maintenance_Controller->run('1')
#6 /var/www/www.serialphotographer.com/gallery3/modules/gallery/controllers/admin.php(50): call_user_func_array(Array, Array)
#7 [internal function]: Admin_Controller->__call('maintenance', Array)
#8 /var/www/www.serialphotographer.com/gallery3/system/core/Kohana.php(291): ReflectionMethod->invokeArgs(Object(Admin_Controller), Array)
#9 [internal function]: Kohana::instance(NULL)
#10 /var/www/www.serialphotographer.com/gallery3/system/core/Event.php(209): call_user_func_array(Array, Array)
#11 /var/www/www.serialphotographer.com/gallery3/system/core/Bootstrap.php(55): Event::run('system.execute')
#12 /var/www/www.serialphotographer.com/gallery3/index.php(72): require('/var/www/www.se...')
#13 {main}
2009-06-14 11:09:57 +02:00 --- error: Uncaught Exception: @todo G2_FUNCTION_FAILED in file modules/g2_import/helpers/g2_import.php on line 757

 
hleroy

Joined: 2005-02-15
Posts: 10
Posted: Sun, 2009-06-14 09:35

I think this log is more relevant.

What does "Missing object for 41626" means? What should I do?

2009-06-14 11:32:30 +02:00 --- error: Gallery2 call failed with: Error (ERROR_MISSING_OBJECT) : Missing object for 41626 <b>in</b> modules/core/classes/GalleryStorage/GalleryStorageExtras.class <b>at line</b> 2054 (GalleryCoreApi::error)
<b>in</b> modules/core/classes/GalleryStorage/GalleryStorageExtras.class <b>at line</b> 98 (GalleryStorageExtras::_identifyEntities)
<b>in</b> modules/core/classes/GalleryStorage.class <b>at line</b> 313 (GalleryStorageExtras::loadEntities)
<b>in</b> modules/core/classes/helpers/GalleryEntityHelper_simple.class <b>at line</b> 71 (GalleryStorage::loadEntities)
<b>in</b> modules/core/classes/GalleryCoreApi.class <b>at line</b> 2361 (GalleryEntityHelper_simple::loadEntitiesById)
<b>in</b> modules/core/classes/GalleryChildEntity.class <b>at line</b> 145 (GalleryCoreApi::loadEntitiesById)
<b>in</b> modules/core/classes/GalleryFileSystemEntity.class <b>at line</b> 283 (GalleryChildEntity::fetchParent)
<b>in</b> modules/core/classes/GalleryDataItem.class <b>at line</b> 377 (GalleryFileSystemEntity::fetchContainerPath)
<b>in</b> /var/www/www.serialphotographer.com/gallery3/modules/g2_import/helpers/g2_import.php <b>at line</b> 385 (GalleryDataItem::fetchPath)
<b>in</b> /var/www/www.serialphotographer.com/gallery3/modules/g2_import/helpers/g2_import_task.php <b>at line</b> 126 (g2_import_Core::import_item)
<b>in</b> ??? <b>at line</b> 0 (g2_import_task_Core::import)
<b>in</b> /var/www/www.serialphotographer.com/gallery3/modules/gallery/helpers/task.php <b>at line</b> 78
<b>in</b> /var/www/www.serialphotographer.com/gallery3/modules/gallery/controllers/admin_maintenance.php <b>at line</b> 140 (task_Core::run)
<b>in</b> ??? <b>at line</b> 0 (Admin_Maintenance_Controller::run)
<b>in</b> /var/www/www.serialphotographer.com/gallery3/modules/gallery/controllers/admin.php <b>at line</b> 50
<b>in</b> ??? <b>at line</b> 0 (Admin_Controller::__call)
<b>in</b> /var/www/www.serialphotographer.com/gallery3/system/core/Kohana.php <b>at line</b> 291 (ReflectionMethod::invokeArgs)
<b>in</b> ??? <b>at line</b> 0 (Kohana::instance)
<b>in</b> /var/www/www.serialphotographer.com/gallery3/system/core/Event.php <b>at line</b> 209
<b>in</b> /var/www/www.serialphotographer.com/gallery3/system/core/Bootstrap.php <b>at line</b> 55 (Event::run)
<b>in</b> /var/www/www.serialphotographer.com/gallery3/index.php <b>at line</b> 72

 
hleroy

Joined: 2005-02-15
Posts: 10
Posted: Sun, 2009-06-14 13:16

I found that object 41626 was referenced as a ParentId in the ChildEntity table in G2, but the object didn't exist in any other tables. I deleted all references to this object. I had to start the import from scratch and it has passed the blocking object.

I think I'm not the only one with a corrupted database (maybe an upload process was interrupted?)
For the developpers: is it possible to handle gracefully such type of error?

Thanks

Hervé

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Sun, 2009-06-14 14:56

Yup, I'm slowly adding more graceful degradation code to deal with corruption. I believe that the latest code will deal with this failure gracefully.
---
Problems? Check gallery3/var/logs before you post! and file bugs here!
Latest code/upgrading: http://codex.gallery2.org/Gallery3:Upgrading
Latest git: http://codex.gallery2.org/Gallery:Using_Git

 
hleroy

Joined: 2005-02-15
Posts: 10
Posted: Sun, 2009-06-14 16:14

Thanks Bharat.

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Tue, 2009-06-16 21:51

Using the current code from git my import from G2 is still hanging after 3721 items because of some missing item. Here's the log:

2009-06-16 17:25:29 -04:00 --- error: Gallery2 call failed with: Error (ERROR_MISSING_OBJECT) : Missing object for 11458 in modules/core/classes/GalleryStorage/GalleryStorageExtras.class at line 2054 (GalleryCoreApi::error)
in modules/core/classes/GalleryStorage/GalleryStorageExtras.class at line 98 (GalleryStorageExtras::_identifyEntities)
in modules/core/classes/GalleryStorage.class at line 313 (GalleryStorageExtras::loadEntities)
in modules/core/classes/helpers/GalleryEntityHelper_simple.class at line 71 (GalleryStorage::loadEntities)
in modules/core/classes/GalleryCoreApi.class at line 2361 (GalleryEntityHelper_simple::loadEntitiesById)
in modules/core/classes/GalleryChildEntity.class at line 145 (GalleryCoreApi::loadEntitiesById)
in modules/core/classes/GalleryFileSystemEntity.class at line 283 (GalleryChildEntity::fetchParent)
in modules/core/classes/GalleryDataItem.class at line 377 (GalleryFileSystemEntity::fetchContainerPath)
in /usr/local/gallery3/modules/g2_import/helpers/g2_import.php at line 404 (GalleryDataItem::fetchPath)
in /usr/local/gallery3/modules/g2_import/helpers/g2_import_task.php at line 126 (g2_import_Core::import_item)
in ??? at line 0 (g2_import_task_Core::import)
in /usr/local/gallery3/modules/gallery/helpers/task.php at line 78
in /usr/local/gallery3/modules/gallery/controllers/admin_maintenance.php at line 140 (task_Core::run)
in ??? at line 0 (Admin_Maintenance_Controller::run)
in /usr/local/gallery3/modules/gallery/controllers/admin.php at line 50
in ??? at line 0 (Admin_Controller::__call)
in /usr/local/gallery3/system/core/Kohana.php at line 291 (ReflectionMethod::invokeArgs)
in ??? at line 0 (Kohana::instance)
in /usr/local/gallery3/system/core/Event.php at line 209
in /usr/local/gallery3/system/core/Bootstrap.php at line 55 (Event::run)
in /usr/local/gallery3/index.php at line 82

2009-06-16 17:25:29 -04:00 --- error: @todo G2_FUNCTION_FAILED in /usr/local/gallery3/modules/g2_import/helpers/g2_import.php at line 794:
#0 /usr/local/gallery3/modules/g2_import/helpers/g2_import.php(404): g2(Array)
#1 /usr/local/gallery3/modules/g2_import/helpers/g2_import_task.php(126): g2_import_Core::import_item(Array)
#2 [internal function]: g2_import_task_Core::import(Object(Task_Model))
#3 /usr/local/gallery3/modules/gallery/helpers/task.php(78): call_user_func_array('g2_import_task:...', Array)
#4 /usr/local/gallery3/modules/gallery/controllers/admin_maintenance.php(140): task_Core::run('1')
#5 [internal function]: Admin_Maintenance_Controller->run('1')
#6 /usr/local/gallery3/modules/gallery/controllers/admin.php(50): call_user_func_array(Array, Array)
#7 [internal function]: Admin_Controller->__call('maintenance', Array)
#8 /usr/local/gallery3/system/core/Kohana.php(291): ReflectionMethod->invokeArgs(Object(Admin_Controller), Array)
#9 [internal function]: Kohana::instance()
#10 /usr/local/gallery3/system/core/Event.php(209): call_user_func(Array)
#11 /usr/local/gallery3/system/core/Bootstrap.php(55): Event::run('system.execute')
#12 /usr/local/gallery3/index.php(82): require('/usr/local/gall...')
#13 {main}
2009-06-16 17:25:29 -04:00 --- error: Uncaught Exception: @todo G2_FUNCTION_FAILED in file modules/g2_import/helpers/g2_import.php on line 794

So how do I fix item 11458?

 
hleroy

Joined: 2005-02-15
Posts: 10
Posted: Wed, 2009-06-17 05:58

Windracer: I used PhpMyAdmin to lookup in the tables the missing object and delete all references to this object.

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Wed, 2009-06-17 14:07

Ok, I found rows in ChildEntity that had the parentID of 11458, so I deleted those. I went through a few of the other tables looking for 11458 and didn't find any, so I started the import over again. It hung at the same place with the same error and 11458 missing object.

Any other tables I should be looking in to clean this out?

 
hleroy

Joined: 2005-02-15
Posts: 10
Posted: Thu, 2009-06-18 07:07

I don't remember in which tables I removed the object, but there was definitely more than one table. I did a full text search on the database from the PhpMyAdmin interface of my web host. This is how I managed to find the other occurences.

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Thu, 2009-06-18 12:30

Thanks for the tip ... I had never tried doing a full-text search like that.

Anyway, the search came back negative for the ID, so I'm still stuck.

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Thu, 2009-06-18 14:46

Man, I thought I had it figured out: I reset the database cache for my G2 site and tried the import again, hopeful.

Unfortunately, it hung in the same exact place again. Same error (different line), but no reference to the missing object 11458 this time, so I'm stuck again. Looks like it's checking the count of records against the count of target ids and they don't match so it throus the missing object error. *sigh*

2009-06-18 10:37:02 -04:00 --- error: Gallery2 call failed with: Error (ERROR_MISSING_OBJECT)in modules/core/classes/GalleryStorage/GalleryStorageExtras.class at line 167 (GalleryCoreApi::error)
in modules/core/classes/GalleryStorage.class at line 313 (GalleryStorageExtras::loadEntities)
in modules/core/classes/helpers/GalleryEntityHelper_simple.class at line 71 (GalleryStorage::loadEntities)
in modules/core/classes/GalleryCoreApi.class at line 2361 (GalleryEntityHelper_simple::loadEntitiesById)
in /usr/local/gallery3/modules/g2_import/helpers/g2_import.php at line 401 (GalleryCoreApi::loadEntitiesById)
in /usr/local/gallery3/modules/g2_import/helpers/g2_import_task.php at line 126 (g2_import_Core::import_item)
in ??? at line 0 (g2_import_task_Core::import)
in /usr/local/gallery3/modules/gallery/helpers/task.php at line 78
in /usr/local/gallery3/modules/gallery/controllers/admin_maintenance.php at line 140 (task_Core::run)
in ??? at line 0 (Admin_Maintenance_Controller::run)
in /usr/local/gallery3/modules/gallery/controllers/admin.php at line 50
in ??? at line 0 (Admin_Controller::__call)
in /usr/local/gallery3/system/core/Kohana.php at line 291 (ReflectionMethod::invokeArgs)
in ??? at line 0 (Kohana::instance)
in /usr/local/gallery3/system/core/Event.php at line 209
in /usr/local/gallery3/system/core/Bootstrap.php at line 55 (Event::run)
in /usr/local/gallery3/index.php at line 85

2009-06-18 10:37:02 -04:00 --- error: @todo G2_FUNCTION_FAILED in /usr/local/gallery3/modules/g2_import/helpers/g2_import.php at line 794:
#0 /usr/local/gallery3/modules/g2_import/helpers/g2_import.php(401): g2(Array)
#1 /usr/local/gallery3/modules/g2_import/helpers/g2_import_task.php(126): g2_import_Core::import_item(Array)
#2 [internal function]: g2_import_task_Core::import(Object(Task_Model))
#3 /usr/local/gallery3/modules/gallery/helpers/task.php(78): call_user_func_array('g2_import_task:...', Array)
#4 /usr/local/gallery3/modules/gallery/controllers/admin_maintenance.php(140): task_Core::run('1')
#5 [internal function]: Admin_Maintenance_Controller->run('1')
#6 /usr/local/gallery3/modules/gallery/controllers/admin.php(50): call_user_func_array(Array, Array)
#7 [internal function]: Admin_Controller->__call('maintenance', Array)
#8 /usr/local/gallery3/system/core/Kohana.php(291): ReflectionMethod->invokeArgs(Object(Admin_Controller), Array)
#9 [internal function]: Kohana::instance()
#10 /usr/local/gallery3/system/core/Event.php(209): call_user_func(Array)
#11 /usr/local/gallery3/system/core/Bootstrap.php(55): Event::run('system.execute')
#12 /usr/local/gallery3/index.php(85): require('/usr/local/gall...')
#13 {main}
2009-06-18 10:37:02 -04:00 --- error: Uncaught Exception: @todo G2_FUNCTION_FAILED in file modules/g2_import/helpers/g2_import.php on line 794
 
hleroy

Joined: 2005-02-15
Posts: 10
Posted: Thu, 2009-06-18 15:35

You're right. I forgot to mention I reset Gallery cache via the web interface, I ran the "optimize database" too. I have also deleted the g2data/cache folder on disk just to be sure. Keep trying :)

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Thu, 2009-06-18 19:35

Ok, I just committed a change which should make things more robust. We'll try to throw out any users/groups/photos/albums/tags that we can't load from G2. In Galleries with minor corruption, this should be ok. I expect there'll still be some lingering issues in cases where we've got well formed comments attached to malformed photos, etc. But we can work that out. Upgrade according to the instructions in my sig.
---
Problems: Check gallery3/var/logs first!
file a bug or feature request | upgrade to the latest code | use git

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Thu, 2009-06-18 20:23

Thanks bharat! I've pulled the latest code via git and have just kicked off another import. I'll let you know how it goes ...

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Fri, 2009-06-19 11:39

Success! The import finished (it took 3 hours)! Looks like I had quite a few "missing" items in my G2 database:

# Failed to import Gallery 2 item with id: 12147
# Failed to import Gallery 2 item with id: 12150
# Failed to import Gallery 2 item with id: 12153
# Failed to import Gallery 2 item with id: 12156
# Failed to import Gallery 2 item with id: 12159
# Failed to import Gallery 2 item with id: 12162
# Failed to import Gallery 2 item with id: 12165
# Failed to import Gallery 2 item with id: 12168
# Failed to import Gallery 2 item with id: 12171
# Failed to import Gallery 2 item with id: 12174
# Failed to import Gallery 2 item with id: 12177
# Failed to import Gallery 2 item with id: 12180
# Failed to import Gallery 2 item with id: 12183
# Failed to import Gallery 2 item with id: 12186
# Failed to import Gallery 2 item with id: 12189
# Failed to import Gallery 2 item with id: 12192
# Failed to import Gallery 2 item with id: 12197
# Failed to import Gallery 2 item with id: 12200
# Failed to import Gallery 2 item with id: 12203
# Failed to import Gallery 2 item with id: 12206
# Failed to import Gallery 2 item with id: 12209
# Failed to import Gallery 2 item with id: 12212
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )
# from Gallery 2 could not be processed; (imported as )

But at least now it's finished!

It looks like the "could not be processed" errors were all on BMP images I had. I've attached the entire log in case it helps.

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Fri, 2009-06-19 17:31

Ah that makes sense. We don't support BMP images in Gallery 3. We should probably scan your Gallery 2 for all the edge cases and report to you before the import starts...

---
Problems: Check gallery3/var/logs first!
file a bug or feature request | upgrade to the latest code | use git

 
sdolgy

Joined: 2009-06-24
Posts: 12
Posted: Wed, 2009-06-24 19:48

how do you get that logging? my logs are bone dry ...

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Thu, 2009-06-25 01:27

You don't have any log files under /var/logs?

 
Geoff Cloake

Joined: 2009-06-24
Posts: 31
Posted: Thu, 2009-06-25 11:40

I am stuck too. Have installed latest gallery-gallery3-53284ec5b892915c5905ea4f1e3fe76b18d3b576, put "php_value eaccelerator.enable 0" in Gallery3/.htaccess. Get a blank page after pressing [save], and it doesn't generate any relevant var/logs files details. Any pointers on what to do next please?

 
sdolgy

Joined: 2009-06-24
Posts: 12
Posted: Fri, 2009-06-26 11:17

Geoff, get the latest code using git and you'll find that it works...

 
sdolgy

Joined: 2009-06-24
Posts: 12
Posted: Fri, 2009-06-26 11:24

i have one log that doesn't have any of the goodness above in it. see my other thread. getting a little annoyed ... hit a nice wall and can't move on

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Fri, 2009-06-26 12:41

Maybe try turning on extra logging, like described here?

http://gallery.menalto.com/gallery_3.0_beta_1_released?page=1#comment-310536

 
Geoff Cloake

Joined: 2009-06-24
Posts: 31
Posted: Sat, 2009-06-27 04:19

I have done several clean installs with gallery-gallery3-f3e45d49a3fb621d7a23fe7c24af5ad160859687, and still get get a blank page on reaching ../Gallery3/index.php/admin/g2_import/save. The [save] must be functioning as folders/files get added under g2_import. No lines are added to logs. Logs work when I force URL errors. Any Ideas.

 
windracer

Joined: 2007-03-05
Posts: 113
Posted: Sat, 2009-06-27 12:10

Have you disabled any PHP accelerators?

 
Geoff Cloake

Joined: 2009-06-24
Posts: 31
Posted: Sun, 2009-06-28 02:32

I have put "php_value eaccelerator.enable 0" in the .htaccess file in my "Gallery3" folder. I will try a new setup on another host. I assume the import will work across from a remote host.

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Sun, 2009-06-28 04:44

@Geoff, the import has to be on the same machine as your G2. What version of G2 are you importing from? Can you package up your var/modules/g2_import dir and attach it here so that we can examine it?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Geoff Cloake

Joined: 2009-06-24
Posts: 31
Posted: Sun, 2009-06-28 05:12

The Gallery I wish to import from is (according to the readme file) "Gallery 2.1 (Blackjack)". It is on cloake.co.nz/gallery. The 'var' folder is attached. the idea to use another server was that my current host/server my be giving file lock problems - I have Dreamweaver setup to allow Contribute edits.

[edit: removed the zip file-- your passwords were in there! --Bharat]

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Sun, 2009-06-28 05:33

Weird. I'm guessing that there's some unexpected issue in upgrading from Gallery 2.1 (I've only tested with Gallery 2.2 and 2.3). Can I get ssh access to your box to tinker around with this?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Geoff Cloake

Joined: 2009-06-24
Posts: 31
Posted: Sun, 2009-06-28 06:26

This site is hosted by webdrive.co.nz I can only provide FTP access from my reseller account. I will see if they can provide SSH Access or equivalent - need to wait until business hours.

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Sun, 2009-06-28 19:36

I'm trying to import about 29,000 images (and I didn't even add any since Dec 2008) and it just hangs....

Says importing album 183 of 183 and it's at the very beginning for the progress and just sits there. I left it run for about 20 mins with nothing.

I then created the local.php file. Anything else I need to do to troubleshoot?

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Mon, 2009-06-29 07:57

2009-06-29 03:37:47 -04:00 --- alert: Attempting to load Gallery 2 item with id: 18

That's all I get from the log. It stops on that everytime.

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Tue, 2009-06-30 03:01

@Ranger187: are you using the latest code? Did you add that log line yourself? I don't see it in the current code. If you can reproduce this with the latest code I'm happy to dig into it.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Geoff Cloake

Joined: 2009-06-24
Posts: 31
Posted: Tue, 2009-06-30 23:49

Unfortunately our host cannot allow any SSH access to their servers. They suggest I work through an upgrade to 2.2 or 2.3 and then try again. I 'll look at doing this in a few days and let you know how it goes. Cheers

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Wed, 2009-07-01 09:05

@Bharat, I had the issue with it not working when it was setup. ie: http://// and you told me to pull the latest. I did. Then when I try to import my already massive gallery, it shows that error in the /var/logs. All I added was the local.php to the root. Nothing more.

I'm probably one of few on here with a gallery this massive and even re-creating the thumbnails in 2.3 always failed/timed out.

What would really be great, is if during the import, you could SELECT folders (a few, or just 1 at a time) instead of pulling 29,000+ images at once.

What do I need to do/add so that while it "says" it's importing, but the progress bar does nothing but sit for days I can physically see what it's doing? If I have to edit something, or add something, let me know! I'll do it. But for now, the import system to me is not informative enough.

Only change made was added "local.php" to root with code:

<?php defined("SYSPATH") or die("No direct script access.");
define("IN_PRODUCTION", false);

// Set the error reporting level. Use E_ALL unless you have a special need.
error_reporting(E_ALL);

// Disabling display_errors will effectively disable Kohana error display
// and logging. You can turn off Kohana errors in application/config/config.php
ini_set('display_errors', true);

Now the stats again:
Platform Information .Operating System: WINNT
Apache: Unknown <--- IIS7 (Windows Server 2008 x64 SP2)
PHP: 5.2.8
MySQL: 5.1.35-community
Server load: Unavailable

Gallery Stats .Version: 3.0 pre beta 2 (git)
Albums: 182
Photos: 5 <--- FAIL!!

You tell me what ya want me to do and I'll do it. Thanks bro.

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Thu, 2009-07-09 06:42

Bharat, let me know when you can look into this and give me some advice. Thanks!

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Mon, 2009-07-13 03:48

Sorry for the delay. You're using Windows, which is unsupported, but I'm going to assume that is not the problem (I hope it's not, else I'm wasting my time here). So. The first thing we need to do is, get the latest code (see my sig below) and try the import again and figure out what the latest error message is in your logs. The one you posted before must have been generated by an older version of the code because I can't find it now. Also, after it hangs you can browse to Admin > Maintenance and click "[view log]" on your import task and maybe we can find more clues there.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Mon, 2009-07-13 03:53

It's not the server. ;) It imports smaller sites and I've run Gallery on them for years. G3 works with smaller sites I have. But this one it always has issues including in G2. It's just too large. Over 45,000 images.

Do I need to edit/change anything so that I can troubleshoot this more?

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Mon, 2009-07-13 04:20

I've imported 15k photos and it worked properly, so I'm guessing it's not the size it's the diversity and possibly some mild corruption in your G2 data. We'll sort it out.. but let's start from the beginning. Let me know what error you get using a clean install of the latest git code and we'll start narrowing it down.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Mon, 2009-07-13 04:23

Ok. I'll try now.

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Mon, 2009-07-13 05:20
bharat wrote:
Sorry for the delay. You're using Windows, which is unsupported, but I'm going to assume that is not the problem (I hope it's not, else I'm wasting my time here). So. The first thing we need to do is, get the latest code (see my sig below) and try the import again and figure out what the latest error message is in your logs. The one you posted before must have been generated by an older version of the code because I can't find it now. Also, after it hangs you can browse to Admin > Maintenance and click "[view log]" on your import task and maybe we can find more clues there.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

There is no admin > maintenance > view log for the import........ This is what I have so far.....

Last Updated Name Status Info Owner Action
2009-Jul-13 01:18:39 Import from Gallery 2 0% Complete Importing albums (9 of 183) admin cancel

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Mon, 2009-07-13 14:15

Anything in your var/logs files? I'm assuming no since you would have mentioned that. Can you give me an admin account on your gallery so that I can trigger the task from here? I can watch the TCP traffic to see if there's additional errors.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Mon, 2009-07-13 15:26

It's importing now. But at this rate, it will take a month. It's on 2000 out of 32,000+. I'm going to setup a new vmware session on the other box which is 5x faster and see if it speeds up.

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Mon, 2009-07-13 19:18

I think that if we're creative, we can eventually come up with a much faster approach that doesn't use the G2 API to get the data, but just talks directly to the database and only does file copies. But that's going to be a hard solution to implement and it's hard for us to give it a high priority at this time. :-/
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Tue, 2009-07-14 08:01

Yeah, I have to say with people with large databases, this won't be a good solution and will be a big determing factor in using the product from G2 > G3.

I'm half tempted to say screw importing, just copy/paste the images from site 1, to new site and import.

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Tue, 2009-07-14 13:39

How many photos are you importing a day? You should be able to import at *least* 10k photos a day so it'll take 3 days. Yeah, that sucks. But leave it running, it gets done and then you don't have to do it again.
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Tue, 2009-07-21 01:17

Well, I got about 17,000 imported, then the log file just fills up. Bharat, should I email the log to you? It's about 6 megs.

 
bharat
bharat's picture

Joined: 2002-05-21
Posts: 7994
Posted: Tue, 2009-07-21 14:03

Try this:
1) get the latest code
2) go to Admin > Maintenance and cancel all jobs, and delete old jobs
3) run the g2 import again

How does that go?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git | help! vote!

 
Ranger187
Ranger187's picture

Joined: 2005-12-02
Posts: 204
Posted: Thu, 2009-07-23 20:28

That seemed to work.