> For the complete documentation index, see [llms.txt](https://blackswanwtf.gitbook.io/docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://blackswanwtf.gitbook.io/docs/smart-agents/data-collection-service.md).

# Data Collection Service

The market data collection services continuously gathers real-time financial market data from multiple sources and makes it available to all other services. Think of it as the system's eyes and ears, constantly watching the markets and collecting information.

## Data Sources

| Data Type                  | Source                           | Collection Interval     | API Provider                    |
| -------------------------- | -------------------------------- | ----------------------- | ------------------------------- |
| **Bitcoin Price**          | CoinGecko API                    | Every 60 seconds        | CoinGecko                       |
| **Ethereum Price**         | CoinGecko API                    | Every 60 seconds        | CoinGecko                       |
| **Solana Price**           | CoinGecko API                    | Every 60 seconds        | CoinGecko                       |
| **S\&P 500**               | Alpha Vantage + Yahoo Finance    | Every 60 seconds (24/7) | Alpha Vantage, Yahoo Finance    |
| **Fear & Greed Index**     | Alternative.me + VIX             | Every 60 seconds        | Alternative.me, Alpha Vantage   |
| **Currency Rates**         | Alpha Vantage + ExchangeRate-API | Every 60 seconds        | Alpha Vantage, ExchangeRate-API |
| **Bull Market Indicators** | CoinGlass API                    | Every 15 minutes        | CoinGlass                       |
| **Daily OHLCV**            | CoinGlass API                    | Once daily (02:10 UTC)  | CoinGlass                       |

## Key Features

**Real-time Data Collection**\
High-frequency data collection from multiple financial APIs

**Multi-Source Integration**\
Aggregates data from 6+ different financial data providers

**Redis Caching**\
High-performance in-memory storage for real-time data access

**Firestore Backup**\
Automated snapshots for data recovery and historical analysis


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://blackswanwtf.gitbook.io/docs/smart-agents/data-collection-service.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.