Slow delete album and organise album not working recently
|
andy duggan
Joined: 2006-05-21
Posts: 79 |
Posted: Wed, 2010-12-01 10:56
|
|
No change in files from 3.0 but a few odd things happening recently... 'Organise' album stopped working - it justs hangs there 'waiting for domain.com'. Maybe its something with recent flash updates? Or server... I dont know. Im on Bluehost. Slow delete album Excrutiatingly slow...Its taking 10-15 minutes to delete 1 album, sometimes much longer, even with only 20-100 photos. They are sub-albums and wondering if that has anything to do with it as it deleted a main page album much quicker. Andy |
|
Posts: 25965
There has been a few fixes to G3.0 in the delete functionality. You can upgrade to an experimental version to see if it helps.
Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team
Posts: 79
Organize panel is working again with the experimental version. Im timing the deletion of a sub-album with 70 photos (500k to 1bm each) ... its slow... 7 minutes now and still going.
Just done... 7 minutes to delete an album with 70 photos/ 80MB. Got several more to go.
A second similar sized album took the same time.
Got another album (hundred photos or so)and now nearly 1 hour and still not done deleting.
Posts: 7985
That's pretty darn slow. I fixed a few places where we were seeing serious slowdown, and now I can't reproduce the problem. On my box it takes me 5 seconds to delete an album with 100 photos in it. If you open up a second window and check out the album as it's deleting, are photos actually going away? If you run mysqladmin or mytop, do you see a lot of mysql activity?
---
Problems? Check gallery3/var/logs
bugs/feature req's | upgrade to the latest code | use git
Posts: 103
I have the same problem as andy duggan.
Deleting albums take:
26 elements = 30 sec
77 elements = 7 min
111 elements = over 10 min and not finished yet
Using Gallery 3.0.2 (build 37 on branch 3.0.x)
Posts: 25965
I can't reproduce. I can delete an album with over 150 items in less than 3 seconds.
Gallery 3.0.2 (branch 3.0.x, build 37)
Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team
Posts: 103
Hm, strange to me. The server is a dedicated server from strato running with 4gb ram and I'm only hosting two domain on this machine. One with nearly no traffic and the gallery site, with a little bit of traffic and nearly 200.000 pictures.
Any hints where I could start looking or want to try by yourself? I would pm you a temp admin account to the gallery
Posts: 25965
I am no DB expert but this light help:
Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team
Posts: 103
No, there is only two entrys in the processlist.
One for G3 and one for the command to show the processlist. What I see, when I delete a album is the following:
When I open a second window I can see that photos are being deleted. But after a while this process stops and no photos gets deleted anymore but the dialog of G3 (that there is a deleting process going on is still viewable).
When I hit F5 I can see that deletion wen ton in the following steps:
207 to 144 -> process stopped
144 to 73 -> process stopped
73 to 26 -> process stopped
26 to 0 -> process stopped
Not sure if this is related to my topic, but this is what I have in the log for today:
<?php defined('SYSPATH') or die('No direct script access.'); ?>
2011-05-16 04:15:23 +02:00 --- error: Database_Exception [ 44 ]: #1064: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'IS NULL' at line 3 [ SELECT COUNT(*) AS `records_found`
FROM `items`
WHERE (`items`.`view_1` = '1') AND `parent_id` = NULL AND IS NULL ]
/var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database_Mysqli_Result.php [ 27 ]
#0 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database_Mysqli.php(79): Database_Mysqli_Result_Core->__construct(false, 'SELECT COUNT(*)...', Object(mysqli), true)
#1 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database.php(272): Database_Mysqli_Core->query_execute('SELECT COUNT(*)...')
#2 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/modules/gallery/libraries/MY_Database.php(45): Database_Core->query('SELECT COUNT(*)...')
#3 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database_Builder.php(973): Database->query('SELECT COUNT(*)...')
#4 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database_Builder.php(933): Database_Builder_Core->execute()
#5 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/ORM.php(1150): Database_Builder_Core->count_records('items')
#6 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/modules/gallery/helpers/item.php(341): ORM_Core->count_all()
#7 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/modules/gallery/controllers/albums.php(40): item_Core::get_position(Object(Item_Model))
#8 [internal function]: Albums_Controller->show(Object(Item_Model))
#9 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/core/Kohana.php(331): ReflectionMethod->invokeArgs(Object(Albums_Controller), Array)
#10 [internal function]: Kohana_Core::instance(NULL)
#11 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/core/Event.php(208): call_user_func_array(Array, Array)
#12 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/application/Bootstrap.php(67): Event_Core::run('system.execute')
#13 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/index.php(102): require('/var/www/vhosts...')
#14 {main}
2011-05-16 08:51:59 +02:00 --- error: Database_Exception [ 44 ]: #1064: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'IS NULL' at line 3 [ SELECT COUNT(*) AS `records_found`
FROM `items`
WHERE `parent_id` = NULL AND IS NULL ]
/var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database_Mysqli_Result.php [ 27 ]
#0 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database_Mysqli.php(79): Database_Mysqli_Result_Core->__construct(false, 'SELECT COUNT(*)...', Object(mysqli), true)
#1 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database.php(272): Database_Mysqli_Core->query_execute('SELECT COUNT(*)...')
#2 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/modules/gallery/libraries/MY_Database.php(45): Database_Core->query('SELECT COUNT(*)...')
#3 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database_Builder.php(973): Database->query('SELECT COUNT(*)...')
#4 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/Database_Builder.php(933): Database_Builder_Core->execute()
#5 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/libraries/ORM.php(1150): Database_Builder_Core->count_records('items')
#6 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/modules/gallery/helpers/item.php(341): ORM_Core->count_all()
#7 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/modules/gallery/controllers/albums.php(40): item_Core::get_position(Object(Item_Model))
#8 [internal function]: Albums_Controller->show(Object(Item_Model))
#9 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/core/Kohana.php(331): ReflectionMethod->invokeArgs(Object(Albums_Controller), Array)
#10 [internal function]: Kohana_Core::instance(NULL)
#11 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/system/core/Event.php(208): call_user_func_array(Array, Array)
#12 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/application/Bootstrap.php(67): Event_Core::run('system.execute')
#13 /var/www/vhosts/domainname_here/subdomains/gallery/httpdocs/index.php(102): require('/var/www/vhosts...')
#14 {main}
2011-05-16 09:00:46 +02:00 --- error: File not found: 2002_finished/02-12-21---House-of-Happiness-E-Block-HN
2011-05-16 09:03:25 +02:00 --- error: File not found: 2002_finished/02-12-06---Techno-Union-Sinus-Kandel--online
Posts: 7985
That's surprisingly slow. We had problems with this in the past, but made significant improvements in 3.0.1 (if I recall correctly).
I'm happy to investigate, but I'm pretty busy right now so it might take me a while (a couple of weeks). PM me with details or email me at
---
Problems? Check gallery3/var/logs
file a bug/feature ticket | upgrade to the latest code! | hacking G3? join us on IRC!
Posts: 103
Sorry, for coming back so late, but RL was a little bit complicated in the last weeks for me.
I just installed 3.0.2 today and tried again to delete an album, but the behaviour didn't change.
@bharat: What information would you need from me to investigate this problem? Administrator login to the site? And what else?
Posts: 25965
URL, SSH access username/password, admin username/password fopr G3.
Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team
Posts: 103
Hi there,
just want to ask, if there is something new on this topic?
thx
ty2d
Posts: 25965
Some work has been done. The organize module was rewritten. I don't know if anybody sent Bharat any info about the slow delete or not.
Dave
_____________________________________________
Blog & G2 || floridave - Gallery Team
Posts: 48
Hello all.
Could it been a server issue?
I mean.. I used to use G2 and it was always slow.. Everything was slow..
Openening the site took ages, uploading/deleting took ages...
Most of the time after seeing 1 photo, and clicking on something else on the site came the message database error.
By that I mean 95% after clicking on anything.
Now I have G3 and really start to like it, but is also slow..
Open my Gallery3 website, open albums/photos, uploading/deleting, register, login, logout, admin, modules everything I do takes a long time..
I was thinking that it might be the server where I host my gallery.
I have both G2 (still online till G3 is ready) and G3 on the same server (but different folders/url)with the same "problems".
I am trying a clean 3.02 install without extra modules on a different server now.
Actually the same issue... slow.
click add photo 6 seconds before uploadscreen is there.
12 seconds before i can click on Done
18 seconds before the photo is on the website. 36 seconds from Add photo till photo is on the website..
Delete photo: Click on delete, takes 10 seconds before delete screen is there. Click on delete and 21 seconds later the website is back with "There aren't any photos here yet! Add some."
As I don't know what the normal "speed" is for a gallery, is this a bit dissapointed.
I don't blame the galley script, because I think it is server "problem".
I only wish my site could be so fast like Greydragon and Reisetraeume
We can have a dream or not?
Greeting,
Tessa
Posts: 16503
Yes, that's a server issue.
No need to dream, just use a quality host.
____________________________________________
Like Gallery? Like the support? Donate now!
Posts: 103
I did sent Bharat a mail with some user accounts to the server and to the G3 installation on my server
Posts: 7985
It's still in my queue.. sorry been really busy (and travelling)
---
Problems? Check gallery3/var/logs
file a bug/feature ticket | upgrade to the latest code! | hacking G3? join us on IRC!
Posts: 48
I'm open for suggestions!!!
Posts: 7985
I checked out @ty2d's site -- the problem there is that he has 180k photos. Since we cannot depend on transactionality, every time you insert or delete a photo it takes an extra second or so because it has to update the MPTT tree pointers. When uploading an image, this is not as noticeable. But when you're deleting 50 images it seems like it should be a single operation but it's 50 1+ second operations back to back.
I'm investigating fixes for this but they're tricky and they all run some data integrity risk.
---
Problems? Check gallery3/var/logs
file a bug/feature ticket | upgrade to the latest code! | hacking G3? join us on IRC!