Dan, First of all, i would like thank you for all the efforts you have put into these modules.
I've used your S3 module with Scheduler and came across a couple of issues and wondering if you or someone else may experienced same issues and might be able to point me to the right direction.
1: When S3 module is active, i am unable to upload pictures. I get the following error message when uploading pictures.
"He-did-it.jpg - Unable to process this photo"
Disabling the module allows me to upload pictures without any issue.
2: I had to uninstall Task Scheduler from my Gallery and now I am unable to install it again.
I've even removed the Database entry related to the scheduler. The error message i get is the following:
"An error occurred while installing the Scheduler module"
On a different note: if anyone wants to use this module, please make sure you do not have any spaces in your file names. Otherwise, the upload to your S3 will not complete.
Thanks in advance.
Faheem
danneh3826
Joined: 2007-08-18
Posts: 290
Posted: Sun, 2012-09-16 20:56
Hi there,
I am aware of issues revolving around spaces in the filenames. I had previously resolved this issue by url encoding the filenames before they got sent to S3. It's probable that I didn't release it because it wasn't stable. I've since been away from the G3 scene and my modules that I've written, however I'm starting to find time to address issues that have been raised since the current versions were released and I'm attempting to go about fixing them up, resolving the bugs, and adding new features. I've literally just today launched a new version of my transcode module, and the S3 module was the next target on my list.
I've resolved issues such as the spaces in filenames, the use of Cloudfront, and I've been attempting to create a workable solution to use private content on an S3 bucket behind Cloudfront. I'm also intending to allow the use of Cloudfront without syncronisation to S3. I'm not aware of any issues relating to enabling the scheduler (and I'm thinking of overhauling that and re-releasing it too - though this module was never mine to begin with, I modified it to allow aws_s3 to do its job asyncronously). Can you send me a copy of your G3 logs when you attempt to enable the scheduler after it fails to engage? Hopefully there's a clue in there which will shed some light on what's going on, and I can perhaps attempt to replicate and resolve the issue.
As a bit of a side note, for those of you subscribed to this thread and are perhaps waiting for S3 primary storage - unfortunately that's not going to happen. The way G3 is built simply will not accommodate what this needs to achieve. It's nothing to do with G3 as a product as a whole - it's a perfectly good gallery application written very well and in a very modular fashion. It's just, not *that* modular. There's no way to hook into every single file access/open/read/write/close that G3 does and that S3 primary storage would need to intercept to fetch files as-and-when required, and then to accommodate that for other modules which read image data from the files also (exif, iptc, gps, transcode...), it's just not possible. Sorry.
I'm having trouble getting this module to work fully. I installed and configured the scheduler and the aws_s3 module. I used server add to add an album. I ran the synchronize tool in the maintenance section. Log messages indicate all steps completed successfully. From the Amazon AWS S3 console, I can see that the images have been uploaded to the S3 bucket. But when I browse the images in G3, the files are still being served from my local machine, rather than from amazon. I see no evidence that the image URLs are being rewritten to point to amazon S3. Any suggestions?
Thanks,
Mike
mikebull
Joined: 2012-09-29
Posts: 2
Posted: Sat, 2012-09-29 18:32
This has been resolved. I overlooked the "S3 enabled" checkbox on the settings page.
Mike
danneh3826
Joined: 2007-08-18
Posts: 290
Posted: Sat, 2012-09-29 22:07
Yea, that helps That's only there in case you want to use Cloudfront only with a custom-origin being your server. It prevents the upload of content to S3, while similarly rewriting the URL's as though it had done.
Amazon recently announced an easier method of getting private content served up with Cloudfront. This was originally pegged for an older version of this module, but failed to progress due to the complexities in adding IAM roles and associating them between an S3 bucket and Cloudfront, and linking the 2 together in the console. Amazon have just made this easier, so this might well be possible after all now - private content, signed and served up via Cloudfront. So if anyone would like that kind of feature, let me know and I'll see if I can hook it up
Love this module! Using v 2.1 on G3 build 251, using a QNAP NAS on a home cable connection .
Syncing stalled but the php script runs smoothly (currently waiting for it to complete ~2000 objects). It stalled while working on files with a space (object counter around 1100) so unclear to me if it was a time-out or the space.
The php script gives the following warning: "Warning: strtotime(): It is not safe to rely on the system's timezone [..] You are required to use the date.timezone or the date_default_timezone_set function (). [..] We selected 'Europe/Berlin' for 'CEST/2.0/DST' instead in [..]/modules/aws_s3/lib/s3.php"
Thanks for your work!
Edmond
jaygoldman
Joined: 2012-11-03
Posts: 1
Posted: Sat, 2012-11-03 02:09
Hi Dan!
(I submitted the same comment through your site's Contact form before finding this forum).
I'm running G3 on a Mediatemple server. Everything is running smoothly on that front and I've now installed the aws and scheduler modules. Unfortunately, the "Amazon S3" settings page rejects the Access Key ID, Secret Access Key, and bucket_name fields when I submit it. I've copied them directly from that form and pasted them into Transmit, which is able to mount the S3 bucket with no problem. I checked my error_log but there's nothing in there either.
Any advice on how to continue? I'm happy to make a donation if I can get it working properly!
Thanks,
Jay
-----------------
Technologist, author speaker, designer, generally swell guy. http://jaygoldman.com
25PSi
Joined: 2004-11-28
Posts: 16
Posted: Fri, 2013-01-18 17:38
Hi all
Ok trying to setup the module to try out S3.
Created bucket - Copy/pasted into Module
Through Access Credentials copied Access Key and Secret Key and pasted them into module's appropriate lines. Verified them at http://www.ezs3.com/public/Are_my_Amazon_S3_Keys_Active.cfm to ensure they work and they are: Congratulations, your Amazon S3 Keys are active.
Click Save and got this:
There was a problem with the submitted form. Please check your values and try again.
The Amazon S3 access details provided appear to be incorrect. Please check your values and try again.
I am obviously doing something blandly wrong and was hoping someone could kindly point that out, please.
Thanks in advance.
etduck
Joined: 2013-02-11
Posts: 1
Posted: Mon, 2013-02-11 07:06
i got this error too. keep telling me "your Access Key/Secret Key/Bucket name is invalid".
25PSi wrote:
Hi all
Ok trying to setup the module to try out S3.
Created bucket - Copy/pasted into Module
Through Access Credentials copied Access Key and Secret Key and pasted them into module's appropriate lines. Verified them at http://www.ezs3.com/public/Are_my_Amazon_S3_Keys_Active.cfm to ensure they work and they are: Congratulations, your Amazon S3 Keys are active.
Click Save and got this:
There was a problem with the submitted form. Please check your values and try again.
The Amazon S3 access details provided appear to be incorrect. Please check your values and try again.
I am obviously doing something blandly wrong and was hoping someone could kindly point that out, please.
Thanks in advance.
micks80
Joined: 2012-04-22
Posts: 71
Posted: Sat, 2013-02-23 17:07
etduck wrote:
i got this error too. keep telling me "your Access Key/Secret Key/Bucket name is invalid".
25PSi wrote:
Hi all
Ok trying to setup the module to try out S3.
Created bucket - Copy/pasted into Module
Through Access Credentials copied Access Key and Secret Key and pasted them into module's appropriate lines. Verified them at http://www.ezs3.com/public/Are_my_Amazon_S3_Keys_Active.cfm to ensure they work and they are: Congratulations, your Amazon S3 Keys are active.
Click Save and got this:
There was a problem with the submitted form. Please check your values and try again.
The Amazon S3 access details provided appear to be incorrect. Please check your values and try again.
I am obviously doing something blandly wrong and was hoping someone could kindly point that out, please.
Thanks in advance.
You usually get that error when one of the values is incorrect, please double check and make sure all the values are correct.
micks80
Joined: 2012-04-22
Posts: 71
Posted: Sat, 2013-02-23 17:11
First of all, thanks for the great module. We were re-generating thumbnails and in the middle it crashed the site and also deleted the contents under 'var' folder but we were lucky to have this module and were able to restore all content from S3 in 30 minutes, but now we are encountering this issue:
All our albums exist under S3 but some of them are missing thumbnails and we want to re-generate thumbnails but as the folders are missing from 'var/albums', it's not able to generate thumbnails i think. Is it possible to completely generate thumbnails from the S3 folders?
Posts: 1
Dan, First of all, i would like thank you for all the efforts you have put into these modules.
I've used your S3 module with Scheduler and came across a couple of issues and wondering if you or someone else may experienced same issues and might be able to point me to the right direction.
1: When S3 module is active, i am unable to upload pictures. I get the following error message when uploading pictures.
"He-did-it.jpg - Unable to process this photo"
Disabling the module allows me to upload pictures without any issue.
2: I had to uninstall Task Scheduler from my Gallery and now I am unable to install it again.
I've even removed the Database entry related to the scheduler. The error message i get is the following:
"An error occurred while installing the Scheduler module"
On a different note: if anyone wants to use this module, please make sure you do not have any spaces in your file names. Otherwise, the upload to your S3 will not complete.
Thanks in advance.
Faheem
Posts: 290
Hi there,
I am aware of issues revolving around spaces in the filenames. I had previously resolved this issue by url encoding the filenames before they got sent to S3. It's probable that I didn't release it because it wasn't stable. I've since been away from the G3 scene and my modules that I've written, however I'm starting to find time to address issues that have been raised since the current versions were released and I'm attempting to go about fixing them up, resolving the bugs, and adding new features. I've literally just today launched a new version of my transcode module, and the S3 module was the next target on my list.
I've resolved issues such as the spaces in filenames, the use of Cloudfront, and I've been attempting to create a workable solution to use private content on an S3 bucket behind Cloudfront. I'm also intending to allow the use of Cloudfront without syncronisation to S3. I'm not aware of any issues relating to enabling the scheduler (and I'm thinking of overhauling that and re-releasing it too - though this module was never mine to begin with, I modified it to allow aws_s3 to do its job asyncronously). Can you send me a copy of your G3 logs when you attempt to enable the scheduler after it fails to engage? Hopefully there's a clue in there which will shed some light on what's going on, and I can perhaps attempt to replicate and resolve the issue.
As a bit of a side note, for those of you subscribed to this thread and are perhaps waiting for S3 primary storage - unfortunately that's not going to happen. The way G3 is built simply will not accommodate what this needs to achieve. It's nothing to do with G3 as a product as a whole - it's a perfectly good gallery application written very well and in a very modular fashion. It's just, not *that* modular. There's no way to hook into every single file access/open/read/write/close that G3 does and that S3 primary storage would need to intercept to fetch files as-and-when required, and then to accommodate that for other modules which read image data from the files also (exif, iptc, gps, transcode...), it's just not possible. Sorry.
Dan
danneh.org :: Gallery3
Posts: 2
I'm having trouble getting this module to work fully. I installed and configured the scheduler and the aws_s3 module. I used server add to add an album. I ran the synchronize tool in the maintenance section. Log messages indicate all steps completed successfully. From the Amazon AWS S3 console, I can see that the images have been uploaded to the S3 bucket. But when I browse the images in G3, the files are still being served from my local machine, rather than from amazon. I see no evidence that the image URLs are being rewritten to point to amazon S3. Any suggestions?
Thanks,
Mike
Posts: 2
This has been resolved. I overlooked the "S3 enabled" checkbox on the settings page.
Mike
Posts: 290
Yea, that helps
That's only there in case you want to use Cloudfront only with a custom-origin being your server. It prevents the upload of content to S3, while similarly rewriting the URL's as though it had done.
Amazon recently announced an easier method of getting private content served up with Cloudfront. This was originally pegged for an older version of this module, but failed to progress due to the complexities in adding IAM roles and associating them between an S3 bucket and Cloudfront, and linking the 2 together in the console. Amazon have just made this easier, so this might well be possible after all now - private content, signed and served up via Cloudfront. So if anyone would like that kind of feature, let me know and I'll see if I can hook it up
Dan
-----
danneh.org :: Gallery3
Posts: 1
Love this module! Using v 2.1 on G3 build 251, using a QNAP NAS on a home cable connection
.
Syncing stalled but the php script runs smoothly (currently waiting for it to complete ~2000 objects). It stalled while working on files with a space (object counter around 1100) so unclear to me if it was a time-out or the space.
The php script gives the following warning: "Warning: strtotime(): It is not safe to rely on the system's timezone [..] You are required to use the date.timezone or the date_default_timezone_set function (). [..] We selected 'Europe/Berlin' for 'CEST/2.0/DST' instead in [..]/modules/aws_s3/lib/s3.php"
Thanks for your work!
Edmond
Posts: 1
Hi Dan!
(I submitted the same comment through your site's Contact form before finding this forum).
I'm running G3 on a Mediatemple server. Everything is running smoothly on that front and I've now installed the aws and scheduler modules. Unfortunately, the "Amazon S3" settings page rejects the Access Key ID, Secret Access Key, and bucket_name fields when I submit it. I've copied them directly from that form and pasted them into Transmit, which is able to mount the S3 bucket with no problem. I checked my error_log but there's nothing in there either.
Any advice on how to continue? I'm happy to make a donation if I can get it working properly!
Thanks,
Jay
-----------------
Technologist, author speaker, designer, generally swell guy. http://jaygoldman.com
Posts: 16
Hi all
Ok trying to setup the module to try out S3.
Created bucket - Copy/pasted into Module
Through Access Credentials copied Access Key and Secret Key and pasted them into module's appropriate lines. Verified them at http://www.ezs3.com/public/Are_my_Amazon_S3_Keys_Active.cfm to ensure they work and they are: Congratulations, your Amazon S3 Keys are active.
Click Save and got this:
There was a problem with the submitted form. Please check your values and try again.
The Amazon S3 access details provided appear to be incorrect. Please check your values and try again.
I am obviously doing something blandly wrong and was hoping someone could kindly point that out, please.
Thanks in advance.
Posts: 1
i got this error too. keep telling me "your Access Key/Secret Key/Bucket name is invalid".
Posts: 71
You usually get that error when one of the values is incorrect, please double check and make sure all the values are correct.
Posts: 71
First of all, thanks for the great module. We were re-generating thumbnails and in the middle it crashed the site and also deleted the contents under 'var' folder but we were lucky to have this module and were able to restore all content from S3 in 30 minutes, but now we are encountering this issue:
All our albums exist under S3 but some of them are missing thumbnails and we want to re-generate thumbnails but as the folders are missing from 'var/albums', it's not able to generate thumbnails i think. Is it possible to completely generate thumbnails from the S3 folders?
Thanks,
Mick