Ok, figured out the root cause of my collision error, and it's an interesting one:
The migration module appears to be creating the G2 image files using the G1 image name. (Is this intentional? I'd kinda like the filename to be preserved, or at least have it create files with the correct extension).
In the album that was causing the collision, I've got an image and a subalbum with the same name. The image created first, and then the createdir for the album fails with the collision error because it is attempting to use the same filename.
Obscure
-fedak
p.s. the "platformication" doesn't seem to have made it into a snapshot or the public cvs yet. Have you checked it in or is it just the cvs lag.
aavdberg
Joined: 2002-09-29
Posts: 100
Posted: Thu, 2004-01-08 17:42
Hello,
When i click on cancel in the confirmation screen i get the following error:
Error (ERROR_BAD_PARAMETER) : Missing or not readable file: /www/test-familie-berg.org/albums/1/album.dat
in modules/migrate/classes/Gallery1DataParser.class at line 66 (gallerystatus::error)
in modules/migrate/classes/Gallery1DataParser.class at line 212 (gallery1dataparser::loadfile)
in modules/migrate/ConfirmImport.inc at line 636 (gallery1dataparser::loadalbumfields)
in modules/core/SiteAdmin.inc at line 94 (confirmimportview::loadtemplate)
in modules/core/classes/GalleryView.class at line 205 (siteadminview::loadtemplate)
in main.php at line 259 (siteadminview::doloadtemplate)
in main.php at line 24
jmullan
Joined: 2002-07-28
Posts: 974
Posted: Thu, 2004-01-22 08:40
aavdberg:
Good catch! I thought that i had a unit test for that.
Todo:
Test to see if I really need to check for netpbm / imagemagick before importation
More collision checks - check for image before importing album
Consider International text
Consider Nuke users
Troubleshoot highlights from subalbums
Album permissions
Item ownership (?)
Item permissions (hidden items)
Test importing non images
Archive G1 metadata
Consider [extra_fields]
Caption/Description length - if caption is truncated, put it into the description also? What if the user also has a description custom field? Use both? (that's probably what I will do)
Album Order
convert html to BBCode
Fix cancel button
[/]
jmullan
Joined: 2002-07-28
Posts: 974
Posted: Wed, 2004-01-28 09:37
I did make a few tweaks tonight. You may notice that a few items have been scrubbed from my list.
fedak
Joined: 2003-12-14
Posts: 80
Posted: Thu, 2004-01-29 05:59
Grabbed last night's cut and ran through the migration. In general, things are looking good. Here's what I found:
New Issue:
1st viewing of the album after migration gives the following error:
Warning: rename(c:\nuke\gallery2\tmp\img12E.tmp,c:\nuke\gallery2\cache\6/696):
File exists in c:\nuke\html\modules\gallery2\modules\core\classes\GalleryPlatform.class on line 355
Subsequent views do not generate an error.
Things that look like they're fixed:
- Migration path now works with and w/o the trailing backslash
- Migration "cancel" no longer errors
Things that appear to still be broken:
- Needed to change the hard coded unix slashes in the calls to loadAlbumFields to windows slashes
- Entering an existant, but invalid migration path give an unhandled
"Missing or not readable file: c:\.users/userdb.dat" error
- ERROR_COLLISION when subalbum and photo have same name
- Thumbnails for albums w/ only subalbums not appearing
Unit tests all passed.
-fedak
jmullan
Joined: 2002-07-28
Posts: 974
Posted: Thu, 2004-01-29 07:36
Quote:
change the hard coded unix slashes in the calls to loadAlbumFields to windows slashes
I swear I fixed this before, but it is for sure fixed now..
Todo:
Test to see if I really need to check for netpbm / imagemagick before importation
More collision checks - check for image before importing album
ERROR_COLLISION when subalbum and photo have same name
Consider International text
Consider Nuke users
Troubleshoot highlights from subalbums
Album permissions
Item ownership (?)
Item permissions (hidden items)
Test importing non images
Archive G1 metadata
Consider [extra_fields]
Caption/Description length - if caption is truncated, put it into the description also? What if the user also has a description custom field? Use both? (that's probably what I will do)
Album Order
convert html to BBCode
Entering an existant, but invalid migration path give an unhandled
"Missing or not readable file: c:\.users/userdb.dat" error
Thumbnails for albums w/ only subalbums not appearing
I did check in the path separator fix, so hopefully it should be in everyone's up-to-date G2. Then again, anonymous cvs is laggy these days.
I'm responding to Terje's question in the other thread.
drewish
Joined: 2002-08-19
Posts: 16
Posted: Tue, 2004-02-17 01:36
just installed gallery2 and ran the import for a few of my galleries. everything worked perfectly.
my only point of confusion was when prompted for the album path i assumed i was to put in the path to a specific album instead of the albums root directory. i haven't gone back and checked the wording but perhaps an example would be helpful...
andrew
mgrant
Joined: 2004-08-17
Posts: 100
Posted: Mon, 2005-05-09 16:06
Rather than start a new thread I'll add to this one.
First some details of my install:
Quote:
Gallery version = 2.0-beta-2+ core 0.9.16
PHP version = 4.3.9 cgi-fcgi
Webserver = Microsoft-IIS/6.0
Database = mysqlt 4.0.20a-nt
Toolkits = ArchiveUpload, Exif, Ffmpeg, NetPBM, Thumbnail
Operating system = Windows NT MGRANT 5.2 build 3790
Browser = Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322)
When doing an import from a 1.5 gallery with >1500 images the import stops without error but doesn't complete. This has only happened when I allow the import to build thumbnails. It also occurs in the maintenance section if I import without thumbnails and then build them later.
This is similar to what has been reported in the past where the browser would silently timeout.
It has happened on both windows 2003/IIS6/PHP4 (see above for the details), windows XP/IIS5/PHP4, and Linux (kubuntu)/apache2/php4.
When the import stops there is no obvious way to gracefully recover. I'm left with an empty gallery but if I attempt another import there are name_collisions. So, I end up having to re-initialze the gallery and then import without thumbnails.
Thankfully the "Site Administration -> System Maintenance -> Build all thumbnails/resizes" allows a browser refresh when the timeout occures. This does not have collision problem that the import creates. So, after hours of thumbnail creating and several manual refreshes I'm finally able to get all the thumbs/resizes built but it's a pretty painful process.
Any help here would be appreciated.
Thanks,
-mg
p.s. When importing on my linux boxes I have something in the upper right portion of the browser like "14389231/32M". This is not present on my windows/IE setups.
jmullan
Joined: 2002-07-28
Posts: 974
Posted: Mon, 2005-05-09 17:08
mgrant, there should be a memory display on all browsers.
if you get to the thumbnail creation segment, then you should be able to stop at any point and visit the front page. your thumbnails would not be precached, but it should work.
You should never get collision errors unless something has gone horribly wrong.
Please open a new thread and fill out the support template for each server/install, plus let me know each browser that you are using for each one.
It sounds like you have an image that is not compatible with g2. You should try your best to figure out which image that is and send us a link to the raw image so that we can test it.
Also, try deactivating gd. That makes a lot of problems suddenly disappear. It's weird.
Let me know! Thanks!
mgrant
Joined: 2004-08-17
Posts: 100
Posted: Mon, 2005-05-09 21:01
In IE the memory display is absent. (I'll create a seperate thread for this).
The collision errors occur when I attempt to import the same items from G1 a second time.
I use GD to create the thumbnails because, of all the graphics toolkits, it's the only one that I can get to create square thumbnails that are NOT cropped (I modify the SquareThumbToolkit.class to scale to the large side instead of the small side).
Anyway, I'll run a few more tests with import and post new threads for the relevant results.
Thanks,
-mg
johnstar
Joined: 2004-02-28
Posts: 25
Posted: Sat, 2005-05-21 20:21
I did install 2.0-beta-3 yesterday and played a bit around. The migration tool did work almost without errors, didn't verify those 3 yet, but when looking at the new Gallery, I found mostly thumbnails only. The larger size wasn't migrated.
John
jmullan
Joined: 2002-07-28
Posts: 974
Posted: Sun, 2005-05-22 00:34
johnstar wrote:
I found mostly thumbnails only. The larger size wasn't migrated.
John
Posts: 80
Ok, figured out the root cause of my collision error, and it's an interesting one:
The migration module appears to be creating the G2 image files using the G1 image name. (Is this intentional? I'd kinda like the filename to be preserved, or at least have it create files with the correct extension).
In the album that was causing the collision, I've got an image and a subalbum with the same name. The image created first, and then the createdir for the album fails with the collision error because it is attempting to use the same filename.
Obscure
-fedak
p.s. the "platformication" doesn't seem to have made it into a snapshot or the public cvs yet. Have you checked it in or is it just the cvs lag.
Posts: 100
Hello,
When i click on cancel in the confirmation screen i get the following error:
Error (ERROR_BAD_PARAMETER) : Missing or not readable file: /www/test-familie-berg.org/albums/1/album.dat
in modules/migrate/classes/Gallery1DataParser.class at line 66 (gallerystatus::error)
in modules/migrate/classes/Gallery1DataParser.class at line 212 (gallery1dataparser::loadfile)
in modules/migrate/ConfirmImport.inc at line 636 (gallery1dataparser::loadalbumfields)
in modules/core/SiteAdmin.inc at line 94 (confirmimportview::loadtemplate)
in modules/core/classes/GalleryView.class at line 205 (siteadminview::loadtemplate)
in main.php at line 259 (siteadminview::doloadtemplate)
in main.php at line 24
Posts: 974
aavdberg:
Good catch! I thought that i had a unit test for that.
Todo:
[/]
Posts: 974
I did make a few tweaks tonight. You may notice that a few items have been scrubbed from my list.
Posts: 80
Grabbed last night's cut and ran through the migration. In general, things are looking good. Here's what I found:
New Issue:
1st viewing of the album after migration gives the following error:
Warning: rename(c:\nuke\gallery2\tmp\img12E.tmp,c:\nuke\gallery2\cache\6/696):
File exists in c:\nuke\html\modules\gallery2\modules\core\classes\GalleryPlatform.class on line 355
Subsequent views do not generate an error.
Things that look like they're fixed:
- Migration path now works with and w/o the trailing backslash
- Migration "cancel" no longer errors
Things that appear to still be broken:
- Needed to change the hard coded unix slashes in the calls to loadAlbumFields to windows slashes
- Entering an existant, but invalid migration path give an unhandled
"Missing or not readable file: c:\.users/userdb.dat" error
- ERROR_COLLISION when subalbum and photo have same name
- Thumbnails for albums w/ only subalbums not appearing
Unit tests all passed.
-fedak
Posts: 974
I swear I fixed this before, but it is for sure fixed now..
Todo:
ERROR_COLLISION when subalbum and photo have same name
"Missing or not readable file: c:\.users/userdb.dat" error
[/]
Posts: 90
Hey Jesse!
I'd want to help test G2 on win32/iis6, the installation was fine. I was able to migrate the users successfully, but when I start to migrate albums, I get errors. Could you look at the erros? I posted them in this thread
http://gallery.menalto.com/index.php?name=PNphpBB2&file=viewtopic&t=13293&sid=25f8989f3d8e24c90d06981884d383a4
Many thanks from norway,
Terje
Posts: 80
Terje-
I think you're running into the path seperator issue that Jessie just fixed.
Try this as a workaround:
in ..\G2\modules\migrate\classes\Gallery1DataParser.class
In 2 places, change the following call from
Gallery1DataParser::loadAlbumFields($path . $albumName . '/');
to
Gallery1DataParser::loadAlbumFields($path . $albumName . '\\');
and see if it resolves your problems.
-fedak
Posts: 974
I did check in the path separator fix, so hopefully it should be in everyone's up-to-date G2. Then again, anonymous cvs is laggy these days.
I'm responding to Terje's question in the other thread.
Posts: 16
just installed gallery2 and ran the import for a few of my galleries. everything worked perfectly.
my only point of confusion was when prompted for the album path i assumed i was to put in the path to a specific album instead of the albums root directory. i haven't gone back and checked the wording but perhaps an example would be helpful...
andrew
Posts: 100
Rather than start a new thread I'll add to this one.
First some details of my install:
When doing an import from a 1.5 gallery with >1500 images the import stops without error but doesn't complete. This has only happened when I allow the import to build thumbnails. It also occurs in the maintenance section if I import without thumbnails and then build them later.
This is similar to what has been reported in the past where the browser would silently timeout.
It has happened on both windows 2003/IIS6/PHP4 (see above for the details), windows XP/IIS5/PHP4, and Linux (kubuntu)/apache2/php4.
When the import stops there is no obvious way to gracefully recover. I'm left with an empty gallery but if I attempt another import there are name_collisions. So, I end up having to re-initialze the gallery and then import without thumbnails.
Thankfully the "Site Administration -> System Maintenance -> Build all thumbnails/resizes" allows a browser refresh when the timeout occures. This does not have collision problem that the import creates. So, after hours of thumbnail creating and several manual refreshes I'm finally able to get all the thumbs/resizes built but it's a pretty painful process.
Any help here would be appreciated.
Thanks,
-mg
p.s. When importing on my linux boxes I have something in the upper right portion of the browser like "14389231/32M". This is not present on my windows/IE setups.
Posts: 974
mgrant, there should be a memory display on all browsers.
if you get to the thumbnail creation segment, then you should be able to stop at any point and visit the front page. your thumbnails would not be precached, but it should work.
You should never get collision errors unless something has gone horribly wrong.
Please open a new thread and fill out the support template for each server/install, plus let me know each browser that you are using for each one.
It sounds like you have an image that is not compatible with g2. You should try your best to figure out which image that is and send us a link to the raw image so that we can test it.
Also, try deactivating gd. That makes a lot of problems suddenly disappear. It's weird.
Let me know! Thanks!
Posts: 100
In IE the memory display is absent. (I'll create a seperate thread for this).
The collision errors occur when I attempt to import the same items from G1 a second time.
I use GD to create the thumbnails because, of all the graphics toolkits, it's the only one that I can get to create square thumbnails that are NOT cropped (I modify the SquareThumbToolkit.class to scale to the large side instead of the small side).
Anyway, I'll run a few more tests with import and post new threads for the relevant results.
Thanks,
-mg
Posts: 25
I did install 2.0-beta-3 yesterday and played a bit around. The migration tool did work almost without errors, didn't verify those 3 yet, but when looking at the new Gallery, I found mostly thumbnails only. The larger size wasn't migrated.
John
Posts: 974
what?