Customizing synced content

1. Web scrapping

The scrapping of websites is done by browsertrix-crawler command-line. Find more instructions in the crawling documentation.

Some experimentation is needed to find best practices on how to get exactly the amount of pages we want scraped, and for each language.

The scrapping might take a long time. Use the output warcz files on the next step.

2. Upload to the Cloud

Navigate to the FileBrowser service on the EDT cloud.

There are different directories within the content directory, each for a content type: F-Droid repository data; Desktop installers; Mapeo data (configs and tiles); and Offline Websites.

Create a new folder for your new content if needed:

Make sure there’s enough left storage on the server, and to upload new content simply drag to the folder or use the upload icon to select the file from your computer:

Once the new content is uploaded we can sync it to EDT devices.

3. Sync it

Navigate to the Syncthing service on the EDT cloud and follow the same steps as in Content syncronization.

4. Adding to device

Check instructions on Syncing contenton how to start syncing with a new device. You'll how to get your Syncthing ID.

On the EDT Cloud instance search for that ID:

Give the new device a descriptive name, and got to the Sharing page:

On the Sharing page select all the folders that are relevant for the new device, usually the defautls:

On EDT Cloud you should see that the device is starting to sync:

On the local Offline Toolkit you should also see syncing happening with more details such as download rate, and amount synced so far.

You're done. Now every time the Cloud updates the content folder, the Offline Toolkit devices will automatically sync whenever they're online.