Application: Feed fetching service #57

New issue

Closed

opened 2017-07-09 22:48:11 -04:00 by jking · 1 comment

jking commented

2017-07-09 22:48:11 -04:00

Owner

A service for fetching feeds on a schedule is essential.

There's a few ways of implementing this:

Use PHP's pthreads extension to fetch, parse, and store feeds concurrently
Use popen() to spawn Arsse CLI instances to process feeds
Use curl_multi_init() to make concurrent HTTP calls to the Arsse server
Use a mundane PHP script to process feeds serially

It may make sense to implement all four of these, picking the best of whatever is available in a given environment.

A service for fetching feeds on a schedule is essential. There's a few ways of implementing this: 1. Use PHP's pthreads extension to fetch, parse, and store feeds concurrently 2. Use `popen()` to spawn Arsse CLI instances to process feeds 3. Use `curl_multi_init()` to make concurrent HTTP calls to the Arsse server 3. Use a mundane PHP script to process feeds serially It may make sense to implement all four of these, picking the best of whatever is available in a given environment.