Module: Folder Sync

Hey,
Thank you for this great module, can you my last two posts here:
http://gallery.menalto.com/node/109168

Also it would be great if you can add a feature letting user specify an album for synchronized images.

As for the feature request, you CAN change where your images will be synchronized to:

in folder_sync/controllers/folder_sync.php line 119:

Change 1 to the album_id of desired container album (album_id #1 is the root album)

By default cronjob doesn't perform deletions unless you explicitly allowed it in the options menu: Admin Dashboard -> Settings -> Folder Sync -> Process deleted item?

Also, deletions performed once all images have been imported.

I wish Gallery exception messages were more descriptive. There are multiple reasons when Gallery throws "ORM Validation has failed for items model" exception. Would you be willing in doing some debugging?

What version of Gallery are you running? Looking at the output, I see path "/mysite.com/modules/videos/" which is not present in my version. Is that a separate module you installed?

I've applied that one-line diff but still get the same error:

ORM_Validation_Exception [ 44 ]: ORM Validation has failed for items model
/Volumes/DataRAID/site.com/system/libraries/ORM_Validation_Exception.php [ 20 ]
#0 /Volumes/DataRAID/site.com/modules/videos/models/item.php(82): ORM_Validation_Exception_Core::handle_validation('items', Object(Validation))
#1 /Volumes/DataRAID/site.com/modules/folder_sync/controllers/folder_sync.php(266): Item_Model_Core->delete()
#2 /Volumes/DataRAID/site.com/modules/folder_sync/cron.php(63): Folder_Sync_Controller::cron()
#3 {main}

Working perfectly now! Thanks so much!

First set of warning has something to do with your particular PHP installation: it doesn't supply $_SERVER in the command line mode.

thank you for pointing out Add menu: it's actually a "leftover" that is not supposed to be there.

As for the exception, it's hard to tell what field or validation rule triggers it. I will add additional Exception handling, so we can see what's going on.

Hi siburny,

Thanks for the module - it works great! I'm having one bit of trouble with it, however. I'm trying to change my sync folder to a different album (id 1385), but it won't seem to change - it always will only sync to the root album. I've changed folder_sync.php as suggested - Line 119 now reads

However, when I call cron.php, it still will only sync to the root directory. Do you have any suggestions as to where to go next?

Thanks again and happy holidays!

Here my error log. Thanks!

2013-01-05 11:10:02 +00:00 --- error: ORM_Validation_Exception [ 44 ]: ORM Validation has failed for items model
/media/Megadata/var/www/data/gallery.***.net/html/system/libraries/ORM_Validation_Exception.php [ 20 ]
#0 /media/Megadata/var/www/data/gallery.***.net/html/system/libraries/ORM.php(755): ORM_Validation_Exception_Core::handle_validation('items', Object(Valida$
#1 /media/Megadata/var/www/data/gallery.***.net/html/modules/gallery/models/item.php(773): ORM_Core->validate(NULL)
#2 /media/Megadata/var/www/data/gallery.***.net/html/system/libraries/ORM.php(778): Item_Model_Core->validate()
#3 /media/Megadata/var/www/data/gallery.***.net/html/modules/gallery/libraries/MY_ORM.php(34): ORM_Core->save()
#4 /media/Megadata/var/www/data/gallery.***.net/html/modules/gallery/libraries/ORM_MPTT.php(76): ORM->save()
#5 /media/Megadata/var/www/data/gallery.***.net/html/modules/gallery/models/item.php(367): ORM_MPTT_Core->save()
#6 /media/Megadata/var/www/data/gallery.***.net/html/modules/folder_sync/controllers/folder_sync.php(169): Item_Model_Core->save()
#7 /media/Megadata/var/www/data/gallery.***.net/html/modules/folder_sync/cron.php(63): Folder_Sync_Controller::cron()
#8 {main}
2013-01-05 11:10:02 +00:00 --- error: Validation errors: Array
(
[name] => illegal_data_file_extension
)

2013-01-05 11:10:02 +00:00 --- error: Kohana_PHP_Exception [ 8192 ]: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/ming.ini on line 1
Unknown [ 0 ]
#0 [internal function]: Kohana_PHP_Exception_Core::shutdown_handler(NULL)
#1 /media/Megadata/var/www/data/gallery.***.net/html/system/core/Event.php(208): call_user_func_array(Array, Array)
#2 /media/Megadata/var/www/data/gallery.***.net/html/system/core/Kohana.php(553): Event_Core::run('system.shutdown')
#3 [internal function]: Kohana_Core::shutdown()
#4 {main}

I will do a quick test to see what might be happening here ...

[update]
So after some testing, it works fine on a brand new installation, but it doesn't work in the case, where cron job was previously run. When a cronjob is run first time, it creates a placeholder in the database which points to a target root folder for the cronjob. In that case, you have to manually update a record in "folder_sync" table (you have to look for a record that has parent_id set to NULL) or alternatively you can delete ALL records (but it has its own repercussions).

I've been working on a really rough module to automatically move photos into a calendar-style structure. I was just going to use Server Add but Folder Sync could be an ideal interface into this. My Calendar auto-structure module is slow because it involves a lot of file moves however Folder Sync could trigger it all at sometime like midnight. I see the possibility where Folder Sync automatically picks up images from an import location and then passes them onto the sync destination where the Calendar auto-structure module will perform the slow structuring process.

What are the chances of removing that hard-coded destination sync location (folder_sync/controllers/folder_sync.php line 119) to at least putting it to a user-specified location? While it should be done at the module installation stage, a quick change at line 119 to something like the following would be enough:

if (module::get_var("folder_sync","destination_folder_id")=="") {
   module::set_var("folder_sync", "destination_folder_id", 1);
}

$entry->item_id = module::get_var("folder_sync","destination_folder_id");

This way, the user can go into the Advanced options to change the destination without modifying any code. Of course, they still need to know the id of the destination, but its a start.

I did help myself. It works great.

Having problems getting this up and running. I have read through the thread and now I am stuck.

I am using build # 269. I have the module installed and configured in Gallery3.
This is my system (uname -a): Linux mythbox 3.2.0-34-generic-pae #53-Ubuntu SMP Thu Nov 15 11:11:12 UTC 2012 i686 athlon i386 GNU/Linux

When I run the cron command from the prompt, I get the following error:

$ /usr/bin/php /var/www/gallery3/modules/folder_sync/cron.php
ORM_Validation_Exception [ 44 ]: ORM Validation has failed for items model
/var/www/gallery3/system/libraries/ORM_Validation_Exception.php [ 20 ]
#0 /var/www/gallery3/system/libraries/ORM.php(755): ORM_Validation_Exception_Core::handle_validation('items', Object(Validation))
#1 /var/www/gallery3/modules/gallery/models/item.php(773): ORM_Core->validate(NULL)
#2 /var/www/gallery3/system/libraries/ORM.php(778): Item_Model_Core->validate()
#3 /var/www/gallery3/modules/gallery/libraries/MY_ORM.php(34): ORM_Core->save()
#4 /var/www/gallery3/modules/gallery/libraries/ORM_MPTT.php(76): ORM->save()
#5 /var/www/gallery3/modules/gallery/models/item.php(367): ORM_MPTT_Core->save()
#6 /var/www/gallery3/modules/folder_sync/controllers/folder_sync.php(214): Item_Model_Core->save()
#7 /var/www/gallery3/modules/folder_sync/cron.php(63): Folder_Sync_Controller::cron()
#8 {main}

This is the same error as ecar and Hdi above, but Hdi's solution (using build 255) does not help me.

ecar mentioned that it could be a rights issue of some sort, so I dropped the php command into a crontab for 'www-data', but no joy.

Also, I tried to specify in the shell that the php command be run by www-data:

as root: su www-data -c /usr/bin/php /var/www/gallery3/modules/folder_sync/cron.php

Again, no joy, it actually just hangs.

So...any ideas? What am I missing? Thanks.

Thanks for the quick reply.

My log shows that same error as Hdi;

2013-01-22 13:09:12 -06:00 --- error: Validation errors: Array
(
[name] => illegal_data_file_extension
)

Running the cronjob in the browser (http://DOMAIN/index.php/folder_sync/cron) gives that same list of errors as in my previous message. Nothing seems different. The first little snip of code from the ORM_Validation_Exception.php is as follows:

SYSPATH/libraries/ORM_Validation_Exception.php[ 20 ]
15 * @param Validation $array
16 * @return
17 */
18 public static function handle_validation($table, Validation $array)
19 {
20 $exception = new ORM_Validation_Exception('ORM Validation has failed for :table model',array(':table'=>$table));
21 $exception->validation = $array;
22 throw $exception;
23 }
24 } // End ORM_Validation_Exception

Is this helpful?
Thanks.

I think I figured it out. Your mention of something not having a valid name clued me in. There is a quirk in how linux handles spaces in folder names and that was gunking up the works (either with the module or gallery3). Changed the folder name to a non-space using name and http://DOMAIN/index.php/folder_sync/cron no longer piches a fit. Will try the cron job tonight. Thanks.

I was looking at the code to folder_sync and server_add while I considered writing a similar module (my idea is to automatically sort images by EXIF creation time, rather than by filesystem path), and I noticed that since you branched off from server_add, there have been some changes made there (mostly small things, like the addition of html::clean or ajax::response instead of just a print()) that might interest you.

This is just an FYI; none of them look horribly critical, but they're probably more "right".

I just wanted to say thank you for the folder_sync module.
I've just donated 20$ to the Gallery project.
We'll also be looking how to integrate gallery into wordpress

I'm feeling very stupid. I can't figure out how to down load the module. Running it will be another issue.
What is git and how do I get the module onto my server? I understand zip files and the like but git????
Help get me past first base please.
Thanks

Try running "php cron.php" instead of "./cron.php"

Make sure you run as apache user to prevent permissions problem.

Thanks
got it.

Folder Sync saves filename, file modified date, and md5 hash of the content of the file. So if any of these parameters are changed on the original file, it will be processed by Folder Sync. As for IPTC keywords, I am not really sure: I am using built-in Gallery functions to update the file, so Gallery is set to process keywords, then it should work.

Oki - thanks for the confirmation. At least I know I'm moving in the right direction now.

Thanks again.
Cheers,
Peter

Just added more information: judging by the amount of open tickets, I will try to tackle it myself probably.