List view

• Full pipeline automatisation

  Input for the scraper requires a list of urls that point to the correct page, where reviews list is already there. The objective is to add a module to fully automatize the procedure, generating the urls file from a raw search on Google Maps, and adding the logic to go to reviews section from the original place url.

  No due date

  •2/3 issues closed
  66% complete1 open2 closed

• Periodic monitoring

  GM limits the number of requests a page can trigger while scrolling, giving a maximum of around 1300 reviews. In order to improve this limitation, the objective is to set up a DB to store the reviews and add a feature to periodically run the scraper to incrementally obtain the new reviews. Scheduling of the scraper will be added using crontab.

  No due date

  •2/2 issues closed
  100% complete0 open2 closed