About this project
This project provides a cloud-based automated scraping solution that can be deployed to a GitHub repository to continuously track real-time sales for Ktown4u fansign events. It uses GitHub Actions scheduled tasks to run one round every 5 minutes, densely scraping at approximately 10-second intervals within each round, and appends the results to a CSV file under the data directory, with fields including time, member, sales, and delta.
The main components include:
- .github/workflows/track.yml: the scheduled workflow configuration
- ktown4u_ci.py: the scraping script
- track_config.json: configuration for the event numbers to monitor, scraping interval, and duration of each round
- data/: automatically generated CSV historical data
The usage process is to create a public repository, upload the above files, enable Actions, and then fill in the event number in track_config.json. Public repositories can use Actions for free without limits, while private repositories only have a monthly quota of 2000 minutes. The data can be viewed or downloaded directly in the repository, or cloned locally and used with the accompanying script to estimate sales ranges.
The project documentation clearly states the limitations: the finest granularity for GitHub scheduled tasks is 5 minutes and may be delayed, so it is not truly continuous 10-second scraping; it can only scrape ongoing or just-ended events, and archived old events cannot be retrieved; if second-level continuous scraping is needed, a dedicated cloud server is required.
Comments
0 Rating appears after 10 ratings
Sign in to join the discussion.