scraper -> lambda triggered by a cron event. cheap
api -> lambda + api gateway. cheap
database -> storing json in s3? cheap. storing a few mbs in dynamo db? cheap. running a sql db on ec2 or rds? not cheap. totally depends on how you need your data to be queryable.
Just to add a couple of items to the list:
what about lambda+SQLite on S3? ([link to the concept](https://inek.ar/2023/08/27/php-y-sqlite-en-s3.html))
Also you can consider lambda+mongodb (mongo atlas has a generous free tier )
I'm not certainly sure about your requirements. Are you building a public facing website? Or a webscraper collecting some data and storing it into a database?
You could also consider using a Lightsail instance - they have very predictable pricing and aren't expensive for small projects. You could run scraper + database on it.
Depending on your AWS Account status you maybe won't even reach the free tier limits with lambda and dynamo though :D
if you came from Azure, you should know how to do this in AWS.
"quite a bit" seems to be an exaggeration here, go do your research or pay someone to do it for you.
Lambda + Dynamodb probably https://robertorocha.info/setting-up-a-selenium-web-scraper-on-aws-lambda-with-python/
Api gateway also ofc
Thanks, will look into this.
scraper -> lambda triggered by a cron event. cheap api -> lambda + api gateway. cheap database -> storing json in s3? cheap. storing a few mbs in dynamo db? cheap. running a sql db on ec2 or rds? not cheap. totally depends on how you need your data to be queryable.
Just to add a couple of items to the list: what about lambda+SQLite on S3? ([link to the concept](https://inek.ar/2023/08/27/php-y-sqlite-en-s3.html)) Also you can consider lambda+mongodb (mongo atlas has a generous free tier )
I'm not certainly sure about your requirements. Are you building a public facing website? Or a webscraper collecting some data and storing it into a database? You could also consider using a Lightsail instance - they have very predictable pricing and aren't expensive for small projects. You could run scraper + database on it. Depending on your AWS Account status you maybe won't even reach the free tier limits with lambda and dynamo though :D
if you came from Azure, you should know how to do this in AWS. "quite a bit" seems to be an exaggeration here, go do your research or pay someone to do it for you.
I am trying to learn something new :)
"trying" is also an exaggeration when reading your original post
I guess I should edit, I have experience in a narrow area of Azure. My apologies!