> For the complete documentation index, see [llms.txt](https://docs.earthdefenderstoolkit.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.earthdefenderstoolkit.com/support-team/online-cloud/customizing-synced-content.md).

# Customizing synced content

### 1. Web scrapping

The scrapping of websites is done by [browsertrix-crawler](https://github.com/webrecorder/browsertrix-crawler) command-line. Find more instructions in the [crawling documentation](https://www.notion.so/Web-Crawling-c8f980b0fac54cdc9c2d9a308461ddd9).

Some experimentation is needed to find best practices on how to get exactly the amount of pages we want scraped, and for each language.

The scrapping might take a long time. Use the output warcz files on the next step.

### 2. Upload to the Cloud

Navigate to the [FileBrowser service](https://files.earthdefenderstoolkit.com) on the EDT cloud.

<figure><img src="https://507198790-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FQezzY4k6FoxghGoX9f5G%2Fuploads%2FOj5R26CS4FBCsEsQMYf9%2FUntitled.png?alt=media&amp;token=b652f92a-c7eb-4d30-8e6a-400bdc70eb22" alt=""><figcaption></figcaption></figure>

There are different directories within the `content` directory, each for a content type: F-Droid repository data; Desktop installers; Mapeo data (configs and tiles); and Offline Websites.

Create a new folder for your new content if needed:

Make sure there’s enough left storage on the server, and to upload new content simply drag to the folder or use the upload icon to select the file from your computer:

<figure><img src="https://507198790-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FQezzY4k6FoxghGoX9f5G%2Fuploads%2FNe2PPgcbiM00FSot3PM5%2FUntitled%201.png?alt=media&amp;token=9e2b3dfe-37b4-4b11-8dd8-328dfefeb1de" alt=""><figcaption></figcaption></figure>

Once the new content is uploaded we can sync it to EDT devices.

### 3. Sync it

Navigate to the [Syncthing service](http://sync.earthdefenderstoolkit.com/) on the EDT cloud and follow the same steps as in [Content syncronization](/device-usage/bundled-applications/content-syncronization.md).

### 4. Adding to device

Check instructions on [Syncing content](/device-usage/first-steps/syncing-content.md)on how to start syncing with a new device. You'll how to get your Syncthing ID.

On the EDT Cloud instance search for that ID:

<figure><img src="https://507198790-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FQezzY4k6FoxghGoX9f5G%2Fuploads%2FpR31eQIYjuvcPMpErFdB%2FUntitled%206.png?alt=media&amp;token=3b3c55dc-462e-4f80-9f85-fae4fa9b3830" alt=""><figcaption></figcaption></figure>

Give the new device a descriptive name, and got to the **Sharing** page:

<figure><img src="https://507198790-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FQezzY4k6FoxghGoX9f5G%2Fuploads%2FjdmKiso3Jl1LT3ClJ3TL%2FUntitled%207.png?alt=media&amp;token=6e0d8955-ba0c-40ca-a722-de4b015f8c76" alt=""><figcaption></figcaption></figure>

On the **Sharing** page select all the folders that are relevant for the new device, usually the defautls:

<figure><img src="https://507198790-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FQezzY4k6FoxghGoX9f5G%2Fuploads%2FAiNiJwxvPJoi7bLPvjk4%2FUntitled%208.png?alt=media&amp;token=5c36fa4b-fd70-42f0-9045-59b396536838" alt=""><figcaption></figcaption></figure>

On EDT Cloud you should see that the device is starting to sync:

<figure><img src="https://507198790-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FQezzY4k6FoxghGoX9f5G%2Fuploads%2FISMVPcbH34rTa8xi89CE%2FUntitled%209.png?alt=media&amp;token=629b19ee-54c9-4c23-8959-ebe2ee34c301" alt=""><figcaption></figcaption></figure>

On the local Offline Toolkit you should also see syncing happening with more details such as download rate, and amount synced so far.

You're done. Now every time the Cloud updates the content folder, the Offline Toolkit devices will automatically sync whenever they're online.


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.

Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:

```
GET https://docs.earthdefenderstoolkit.com/support-team/online-cloud/customizing-synced-content.md?ask=<question>&goal=<user_goal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
