Issue Details (XML | Word | Printable)

Key: MBS-4492
Type: Improvement Improvement
Status: Closed Closed
Resolution: Fixed
Priority: Normal Normal
Assignee: Kuno Woudt
Reporter: Kuno Woudt
Votes: 0
Watchers: 0
Operations

If you were logged in you would be able to see more operations.
MusicBrainz Server

Development server needs to support development of cover art archive things

Created: 26/Mar/12 02:28 PM   Updated: 23/Jul/12 05:24 AM   Resolved: 23/Jul/12 05:24 AM
Component/s: None
Affects Version/s: Cover Art Archive
Fix Version/s: Bug fixes, 2012-07-23


 Description  « Hide

Currently we're using the internet archive.org servers during development of the cover art archive. After launch of coverartacrhive.org we cannot do that anymore, as we would be clobbering real data and introducing fake data onto archive.org servers.

As such, we need to emulate the internet archive part of things sufficiently to allow development separate from the production environment. I see three options here:

1. we ask archive.org to get a collection and a bucket naming scheme to be used for development and testing
2. we reintroduce support for amazon s3 to store cover art during testing
3. we implement a higher level abstraction which stores things locally

I'd prefer the third option, as it doesn't need a credit card and more importantly, doesn't need an internet connection.

Thoughts?

Additionally, we need to:

1. add an admin/sql/CreateCAA.sql script of some sort, to set up the cover_art_archive schema for development.
2. add documentation on how to set up your development mb_server for cover art development (which probably would include CAA-indexer and coverart_redirect)



Sort Order: Ascending order - Click to sort in descending order
Kuno Woudt added a comment - 26/Mar/12 02:35 PM

Option 2 (be able to use any S3 server) might also enable local development if a free implementation of the S3 server protocol can be found. But I am not aware of any mature implementations, I've only found http://littles3.googlecode.com which hasn't seen any active development since 2009.


Oliver Charles added a comment - 26/Mar/12 03:46 PM

Why can't people set up there own archive.org S3 keys and test with that?


Kuno Woudt added a comment - 26/Mar/12 03:57 PM

That you can easily create an account at the internet archive and use it to upload bogus data doesn't mean that you should. I expect the intent of the archive is to get real data in their collection, which is of value to someone.

I am not against using the internet archive servers for testing and development of coverartarchive things, but we should only do so with their knowledge and permission (I listed this as the first option in the bug report).


Oliver Charles added a comment - 26/Mar/12 04:04 PM

Ok, in agreement with all of that.


Kuno Woudt added a comment - 18/Apr/12 06:02 PM

http://blog.getspool.com/2012/04/18/fake-s3-save-time-money-and-develop-offline/ <-- new fake S3 implementation which someone could run locally.


Oliver Charles added a comment - 04/May/12 09:59 AM

Moving improvements out of upcoming version