Processing
pipelines—typical architecture we see uses SQS to tie together workflow of
the application. Smugmug use
case---all companies have processing pipelines—set of data sits in S3, EC2
apps that need to do some processcing on that data (image manipulation,
transcoding)…work items get queued up in SQS and EC2 get spun up to pick the
items off the queue and do the work—then store the results back in S3. |