A company has an application that places hundreds of .csv files into an Amazon S3 bucket every hour. The files are 1 GB in size. Each time a file is uploaded, the company needs to convert the file to Apache Parquet format and place the output file into an S3 bucket. Which solution will meet these requirements with the LEAST operational overhead?
Select one answer.
Marked answer: D
Community Discussion
Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.
Chose D1
How It Works (Typical Architecture)A .csv file is uploaded to an S3 bucket. An S3 Event triggers a Lambda function. Lambda:Downloads the CSV from S3. Converts it to Parquet using libraries like pandas + PyArrow. Uploads the Parquet file to another S3 location (or the same bucket with a different prefix). (Optional) Updates AWS Glue Data Catalog so the data is queryable via Athena.
1
IIRC, many folks on this forum mentioned that, rule of thumbs for AWS exams, opt for AWS managed services...
2
But what if the file conversion process exceeds more than 15 minutes for each file? How does Lambda fits into this picture?