Reddit Migrates Media Metadata From S3 and Other Systems into AWS Aurora Postgres | allainews.com

March 31, 2024, 4 a.m. | Rafal Gancarz

InfoQ - AI, ML & Data Engineering www.infoq.com

Reddit consolidated its media metadata storage into a new architecture using AWS Aurora Postgres. Previously, the company sourced media metadata from various systems, including directly from AWS S3. The new solution simplifies media metadata retrieval and handles 100k+ requests per second with latency below 5ms (p90).

By Rafal Gancarz

ai architecture architecture & design aurora aws aws s3 cassandra latency media metadata ml & data engineering per postgres reddit retrieval s3 solution storage systems the company

More from www.infoq.com / InfoQ - AI, ML & Data Engineering

Java News Roundup: OpenJDK Updates, Piranha Cloud, Spring Data 2024.0.0, GlassFish, Micrometer 2 hours ago | www.infoq.com

ai apache tomcat architecture & design cloud +27

Google Launches Gemini 1.5 Flash for Lower-Latency and More Efficient AI Serving 12 hours ago | www.infoq.com

ai ai models context context window +15

Uber Migrates 1 Trillion Records from DynamoDB to LedgerStore to Save $6 Million Annually 23 hours ago | www.infoq.com

ai architecture & design aws big data +23

Enhanced Security for Enterprises: Google Launches Google Threat Intelligence 1 day ago | www.infoq.com

ai analysis cloud cloud security +24

Rider 2024.1: New Monitoring Tool Window, Collection Vizualizer, .NET Aspire, AI Assistant Plugin 1 day, 9 hours ago | www.infoq.com

ai ai assistant architecture & design artificial intelligence +17

Presentation: Streaming Databases: Embracing the Convergence of Stream Processing and Databases 2 days, 20 hours ago | www.infoq.com

ai convergence database databases +14

Hugging Face Unveils LeRobot, an Open-Source Machine Learning Model for Robotics 3 days, 18 hours ago | www.infoq.com

advanced ai applications daniel +17

Apple Open-Sources One Billion Parameter Language Model OpenELM 5 days, 16 hours ago | www.infoq.com

ai anthony apple attention +12

Podcast: If LLMs Do the Easy Programming Tasks - How are Junior Developers Trained? What … 6 days, 19 hours ago | www.infoq.com

ai anthony developers development +19

Software Engineer for AI Training Data (School Specific)

@ G2i Inc | Remote

View on ai-jobs.net

Software Engineer for AI Training Data (Python)

@ G2i Inc | Remote

View on ai-jobs.net

Software Engineer for AI Training Data (Tier 2)

@ G2i Inc | Remote

View on ai-jobs.net

Data Engineer

@ Lemon.io | Remote: Europe, LATAM, Canada, UK, Asia, Oceania

View on ai-jobs.net

Artificial Intelligence – Bioinformatic Expert

@ University of Texas Medical Branch | Galveston, TX

View on ai-jobs.net

Lead Developer (AI)

@ Cere Network | San Francisco, US

View on ai-jobs.net