Refreshes
To keep your knowledge up to date, Kapa regularly fetches updates from your sources and syncs changes automatically. The only exception is web crawling, where large changes may require human review.
Data refresh frequency
Different sources have different refresh schedules. The Last checked column in the Sources view shows when Kapa last checked each source for changes.
The following table shows the update schedules for each source. New content is newly created objects, such as a new JIRA issue or Notion page. Updates are changes to existing items, like comments on an existing issue. Deletions are deletions of entire objects, such as an entire issue or Slack thread.
| Source | New content | Updates | Deletions |
|---|---|---|---|
| Confluence | 10 minutes | 10 minutes | 48 hours |
| Discord | Two hours | Two hours | 24 hours |
| Discourse | 10 minutes | 10 minutes | 48 hours |
| GitHub discussions | 10 minutes | 10 minutes | 48 hours |
| GitHub Code | One hour | One hour | One hour |
| GitHub issues | Five minutes | Five minutes | 48 hours |
| GitHub pull requests | 10 minutes | 10 minutes | 48 hours |
| Google Drive | 10 minutes | 10 minutes | 24 hours |
| JIRA | 10 minutes | 10 minutes | 48 hours |
| Jira Service Management | Three hours | Three hours | 12 hours |
| Notion | Five minutes | Five minutes | 48 hours |
| OpenAPI | One hour | One hour | One hour |
| S3 Bucket | 10 minutes | 10 minutes | 24 hours |
| Salesforce Cases | 15 minutes | 15 minutes | 48 hours |
| Salesforce Knowledge | One hour | One hour | 48 hours |
| Slack | Six hours | Six hours | 24 hours |
| Web crawling | 24 hours | 24 hours | 24 hours |
| YouTube | 24 hours | 24 hours | 24 hours |
| Zendesk helpcenter | 10 minutes | 10 minutes | 10 minutes |
| Zendesk tickets | Five minutes | Five minutes | Five minutes |
These schedules take into account the rate limits of the third party systems.
Slack
Slack has some specific edge cases. The Slack API doesn't allow pulling changes beyond a given timestamp, and has restrictive rate limits.
To work around this, Kapa scans back seven days, every six hours. In other words, every six hours, Kapa checks all threads from the last seven days and checks if anything was added, changed, or deleted.
This means:
- Kapa accurately reflects changes every six hours.
- Kapa can't see changes to older threads. If a thread from eight or more days ago has changes, Kapa won't pick this up.
If you choose to only keep Slack data for a given time period, Kapa deletes threads that fall outside that timeframe every 48 hours.
Web crawling
Every 24 hours, Kapa re-crawls all pages on your configured websites and syncs only new, modified, and deleted pages; see Refreshes on the Web Crawling page for details. If 45% or more of the pages changed or disappeared since the last crawl, the update is held for human review and needs to be approved before it syncs to production; Reviews covers how this works. Web crawls are also the only source type with manual refreshes.