A 24/7 automation that crawls course information stably with Puppeteer when direct DB access isn't possible, and dispatches KakaoTalk alimtalk on status changes.
The most frustrating kind of operating problem is data you can see but can't read.
The course platform's database wasn't directly accessible. APIs weren't open enough. The operator was visiting the site daily to check course status manually and notifying customers when things shifted.
Human eyes on the same site daily isn't free — and missed changes erode customer trust.
Puppeteer does the daily watching 24/7. KakaoTalk alimtalk fires the moment a change appears.
A Puppeteer-based crawler collects course info periodically and writes it into a database. Status changes trigger automated alimtalk dispatches. The operator only sees the alert that 'something changed.'
Crawlers don't survive site-structure changes by default, so we added monitoring and retry logic to keep the system stable without interruption.
Crawling that tolerates site-structure changes, with retry logic.
Triggers automated dispatch on status changes.