AI/firecrawl
1
0
Fork 0
mirror of https://git.mirrors.martin98.com/https://github.com/mendableai/firecrawl synced 2025-08-20 12:59:13 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,455 Commits 496 Branches 17 Tags
Commit Graph

3455 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
dependabot[bot]
0b00833f2e
apps/api(deps): bump the prod-deps group across 1 directory with 62 updates 
Bumps the prod-deps group with 62 updates in the /apps/api directory:

| Package | From | To |
| --- | --- | --- |
| [@ai-sdk/anthropic](https://github.com/vercel/ai) | `1.2.4` | `1.2.12` |
| [@ai-sdk/deepinfra](https://github.com/vercel/ai) | `0.2.4` | `0.2.15` |
| [@ai-sdk/fireworks](https://github.com/vercel/ai) | `0.2.4` | `0.2.14` |
| [@ai-sdk/google](https://github.com/vercel/ai) | `1.2.3` | `1.2.18` |
| [@ai-sdk/google-vertex](https://github.com/vercel/ai) | `2.2.15` | `2.2.23` |
| [@ai-sdk/groq](https://github.com/vercel/ai) | `1.2.1` | `1.2.9` |
| [@ai-sdk/openai](https://github.com/vercel/ai) | `1.3.12` | `1.3.22` |
| [@anthropic-ai/sdk](https://github.com/anthropics/anthropic-sdk-typescript) | `0.24.3` | `0.52.0` |
| [@apidevtools/json-schema-ref-parser](https://github.com/APIDevTools/json-schema-ref-parser) | `11.7.3` | `12.0.2` |
| [@brillout/import](https://github.com/brillout/import) | `0.2.3` | `0.2.6` |
| [@bull-board/api](https://github.com/felixmosh/bull-board/tree/HEAD/packages/api) | `5.20.5` | `6.9.6` |
| [@bull-board/express](https://github.com/felixmosh/bull-board/tree/HEAD/packages/express) | `5.20.5` | `6.9.6` |
| [@dqbd/tiktoken](https://github.com/dqbd/tiktoken) | `1.0.17` | `1.0.21` |
| [@nangohq/node](https://github.com/NangoHQ/nango/tree/HEAD/packages/node-client) | `0.40.8` | `0.59.13` |
| [@openrouter/ai-sdk-provider](https://github.com/OpenRouterTeam/ai-sdk-provider) | `0.4.5` | `0.7.0` |
| [@sentry/cli](https://github.com/getsentry/sentry-cli) | `2.33.1` | `2.46.0` |
| [@sentry/node](https://github.com/getsentry/sentry-javascript) | `8.26.0` | `9.24.0` |
| [@sentry/profiling-node](https://github.com/getsentry/sentry-javascript) | `8.26.0` | `9.24.0` |
| [@supabase/supabase-js](https://github.com/supabase/supabase-js) | `2.44.2` | `2.49.9` |
| [ai](https://github.com/vercel/ai) | `4.3.5` | `4.3.16` |
| [ajv](https://github.com/ajv-validator/ajv) | `8.16.0` | `8.17.1` |
| [async](https://github.com/caolan/async) | `3.2.5` | `3.2.6` |
| [axios](https://github.com/axios/axios) | `1.7.2` | `1.9.0` |
| [body-parser](https://github.com/expressjs/body-parser) | `1.20.2` | `2.2.0` |
| [bullmq](https://github.com/taskforcesh/bullmq) | `5.36.0` | `5.53.1` |
| [cacheable-lookup](https://github.com/szmarczak/cacheable-lookup) | `6.1.0` | `7.0.0` |
| [cheerio](https://github.com/cheeriojs/cheerio) | `1.0.0-rc.12` | `1.0.0` |
| [cohere-ai](https://github.com/cohere-ai/cohere-typescript) | `7.14.0` | `7.17.1` |
| [cron-parser](https://github.com/harrisiirak/cron-parser) | `4.9.0` | `5.2.0` |
| [date-fns](https://github.com/date-fns/date-fns) | `3.6.0` | `4.1.0` |
| [dotenv](https://github.com/motdotla/dotenv) | `16.4.5` | `16.5.0` |
| [dotenv-cli](https://github.com/entropitor/dotenv-cli) | `7.4.2` | `8.0.0` |
| [express](https://github.com/expressjs/express) | `4.19.2` | `5.1.0` |
| [@types/express](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/express) | `4.17.21` | `5.0.2` |
| [express-rate-limit](https://github.com/express-rate-limit/express-rate-limit) | `7.3.1` | `7.5.0` |
| [glob](https://github.com/isaacs/node-glob) | `10.4.2` | `11.0.2` |
| [ioredis](https://github.com/luin/ioredis) | `5.4.1` | `5.6.1` |
| [jsdom](https://github.com/jsdom/jsdom) | `26.0.0` | `26.1.0` |
| [json-schema-to-zod](https://github.com/StefanTerdell/json-schema-to-zod) | `2.3.0` | `2.6.1` |
| [koffi](https://github.com/Koromix/koffi) | `2.9.0` | `2.11.0` |
| [luxon](https://github.com/moment/luxon) | `3.4.4` | `3.6.1` |
| [mammoth](https://github.com/mwilliamson/mammoth.js) | `1.7.2` | `1.9.1` |
| [marked](https://github.com/markedjs/marked) | `14.1.2` | `15.0.12` |
| [mongoose](https://github.com/Automattic/mongoose) | `8.4.4` | `8.15.1` |
| [natural](https://github.com/NaturalNode/natural) | `7.0.7` | `8.1.0` |
| [posthog-node](https://github.com/PostHog/posthog-js-lite/tree/HEAD/posthog-node) | `4.0.1` | `4.18.0` |
| [puppeteer](https://github.com/puppeteer/puppeteer) | `22.12.1` | `24.10.0` |
| [rate-limiter-flexible](https://github.com/animir/node-rate-limiter-flexible) | `2.4.2` | `7.1.1` |
| [resend](https://github.com/resendlabs/resend-node) | `3.4.0` | `4.5.1` |
| [stripe](https://github.com/stripe/stripe-node) | `16.1.0` | `18.2.1` |
| [supabase](https://github.com/supabase/cli) | `1.172.2` | `2.23.4` |
| [systeminformation](https://github.com/sebhildebrandt/systeminformation) | `5.22.11` | `5.27.1` |
| [tldts](https://github.com/remusao/tldts) | `6.1.75` | `7.0.8` |
| [typesense](https://github.com/typesense/typesense-js) | `1.8.2` | `2.0.3` |
| [undici](https://github.com/nodejs/undici) | `6.20.1` | `7.10.0` |
| [unstructured-client](https://github.com/Unstructured-IO/unstructured-js-client) | `0.11.3` | `0.24.4` |
| [uuid](https://github.com/uuidjs/uuid) | `10.0.0` | `11.1.0` |
| [winston](https://github.com/winstonjs/winston) | `3.14.2` | `3.17.0` |
| [winston-transport](https://github.com/winstonjs/winston-transport) | `4.8.0` | `4.9.0` |
| [ws](https://github.com/websockets/ws) | `8.18.0` | `8.18.2` |
| [@types/ws](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/ws) | `8.5.12` | `8.18.1` |
| [zod](https://github.com/colinhacks/zod) | `3.24.2` | `3.25.48` |



Updates `@ai-sdk/anthropic` from 1.2.4 to 1.2.12
- [Release notes](https://github.com/vercel/ai/releases)
- [Changelog](https://github.com/vercel/ai/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vercel/ai/compare/@ai-sdk/anthropic@1.2.4...@ai-sdk/anthropic@1.2.12)

Updates `@ai-sdk/deepinfra` from 0.2.4 to 0.2.15
- [Release notes](https://github.com/vercel/ai/releases)
- [Changelog](https://github.com/vercel/ai/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vercel/ai/compare/@ai-sdk/deepinfra@0.2.4...@ai-sdk/deepinfra@0.2.15)

Updates `@ai-sdk/fireworks` from 0.2.4 to 0.2.14
- [Release notes](https://github.com/vercel/ai/releases)
- [Changelog](https://github.com/vercel/ai/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vercel/ai/compare/@ai-sdk/fireworks@0.2.4...@ai-sdk/fireworks@0.2.14)

Updates `@ai-sdk/google` from 1.2.3 to 1.2.18
- [Release notes](https://github.com/vercel/ai/releases)
- [Changelog](https://github.com/vercel/ai/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vercel/ai/compare/@ai-sdk/google@1.2.3...@ai-sdk/google@1.2.18)

Updates `@ai-sdk/google-vertex` from 2.2.15 to 2.2.23
- [Release notes](https://github.com/vercel/ai/releases)
- [Changelog](https://github.com/vercel/ai/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vercel/ai/compare/@ai-sdk/google-vertex@2.2.15...@ai-sdk/google-vertex@2.2.23)

Updates `@ai-sdk/groq` from 1.2.1 to 1.2.9
- [Release notes](https://github.com/vercel/ai/releases)
- [Changelog](https://github.com/vercel/ai/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vercel/ai/compare/@ai-sdk/groq@1.2.1...@ai-sdk/groq@1.2.9)

Updates `@ai-sdk/openai` from 1.3.12 to 1.3.22
- [Release notes](https://github.com/vercel/ai/releases)
- [Changelog](https://github.com/vercel/ai/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vercel/ai/compare/@ai-sdk/openai@1.3.12...@ai-sdk/openai@1.3.22)

Updates `@anthropic-ai/sdk` from 0.24.3 to 0.52.0
- [Release notes](https://github.com/anthropics/anthropic-sdk-typescript/releases)
- [Changelog](https://github.com/anthropics/anthropic-sdk-typescript/blob/main/CHANGELOG.md)
- [Commits](https://github.com/anthropics/anthropic-sdk-typescript/compare/sdk-v0.24.3...sdk-v0.52.0)

Updates `@apidevtools/json-schema-ref-parser` from 11.7.3 to 12.0.2
- [Release notes](https://github.com/APIDevTools/json-schema-ref-parser/releases)
- [Commits](https://github.com/APIDevTools/json-schema-ref-parser/compare/v11.7.3...v12.0.2)

Updates `@brillout/import` from 0.2.3 to 0.2.6
- [Commits](https://github.com/brillout/import/compare/v0.2.3...v0.2.6)

Updates `@bull-board/api` from 5.20.5 to 6.9.6
- [Release notes](https://github.com/felixmosh/bull-board/releases)
- [Changelog](https://github.com/felixmosh/bull-board/blob/master/CHANGELOG.md)
- [Commits](https://github.com/felixmosh/bull-board/commits/v6.9.6/packages/api)

Updates `@bull-board/express` from 5.20.5 to 6.9.6
- [Release notes](https://github.com/felixmosh/bull-board/releases)
- [Changelog](https://github.com/felixmosh/bull-board/blob/master/CHANGELOG.md)
- [Commits](https://github.com/felixmosh/bull-board/commits/v6.9.6/packages/express)

Updates `@dqbd/tiktoken` from 1.0.17 to 1.0.21
- [Release notes](https://github.com/dqbd/tiktoken/releases)
- [Changelog](https://github.com/dqbd/tiktoken/blob/main/CHANGELOG.md)
- [Commits](https://github.com/dqbd/tiktoken/compare/@dqbd/tiktoken@1.0.17...@dqbd/tiktoken@1.0.21)

Updates `@nangohq/node` from 0.40.8 to 0.59.13
- [Release notes](https://github.com/NangoHQ/nango/releases)
- [Changelog](https://github.com/NangoHQ/nango/blob/master/CHANGELOG.md)
- [Commits](https://github.com/NangoHQ/nango/commits/v0.59.13/packages/node-client)

Updates `@openrouter/ai-sdk-provider` from 0.4.5 to 0.7.0
- [Release notes](https://github.com/OpenRouterTeam/ai-sdk-provider/releases)
- [Commits](https://github.com/OpenRouterTeam/ai-sdk-provider/compare/v0.4.5...v0.7.0)

Updates `@sentry/cli` from 2.33.1 to 2.46.0
- [Release notes](https://github.com/getsentry/sentry-cli/releases)
- [Changelog](https://github.com/getsentry/sentry-cli/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-cli/compare/2.33.1...2.46.0)

Updates `@sentry/node` from 8.26.0 to 9.24.0
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/8.26.0...9.24.0)

Updates `@sentry/profiling-node` from 8.26.0 to 9.24.0
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/8.26.0...9.24.0)

Updates `@supabase/supabase-js` from 2.44.2 to 2.49.9
- [Release notes](https://github.com/supabase/supabase-js/releases)
- [Changelog](https://github.com/supabase/supabase-js/blob/master/RELEASE.md)
- [Commits](https://github.com/supabase/supabase-js/compare/v2.44.2...v2.49.9)

Updates `ai` from 4.3.5 to 4.3.16
- [Release notes](https://github.com/vercel/ai/releases)
- [Changelog](https://github.com/vercel/ai/blob/main/CHANGELOG.md)
- [Commits](https://github.com/vercel/ai/compare/ai@4.3.5...ai@4.3.16)

Updates `ajv` from 8.16.0 to 8.17.1
- [Release notes](https://github.com/ajv-validator/ajv/releases)
- [Commits](https://github.com/ajv-validator/ajv/compare/v8.16.0...v8.17.1)

Updates `async` from 3.2.5 to 3.2.6
- [Release notes](https://github.com/caolan/async/releases)
- [Changelog](https://github.com/caolan/async/blob/master/CHANGELOG.md)
- [Commits](https://github.com/caolan/async/compare/v3.2.5...v3.2.6)

Updates `axios` from 1.7.2 to 1.9.0
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v1.7.2...v1.9.0)

Updates `body-parser` from 1.20.2 to 2.2.0
- [Release notes](https://github.com/expressjs/body-parser/releases)
- [Changelog](https://github.com/expressjs/body-parser/blob/master/HISTORY.md)
- [Commits](https://github.com/expressjs/body-parser/compare/1.20.2...v2.2.0)

Updates `bullmq` from 5.36.0 to 5.53.1
- [Release notes](https://github.com/taskforcesh/bullmq/releases)
- [Commits](https://github.com/taskforcesh/bullmq/compare/v5.36.0...v5.53.1)

Updates `cacheable-lookup` from 6.1.0 to 7.0.0
- [Release notes](https://github.com/szmarczak/cacheable-lookup/releases)
- [Commits](https://github.com/szmarczak/cacheable-lookup/compare/v6.1.0...v7.0.0)

Updates `cheerio` from 1.0.0-rc.12 to 1.0.0
- [Release notes](https://github.com/cheeriojs/cheerio/releases)
- [Commits](https://github.com/cheeriojs/cheerio/compare/v1.0.0-rc.12...v1.0.0)

Updates `cohere-ai` from 7.14.0 to 7.17.1
- [Release notes](https://github.com/cohere-ai/cohere-typescript/releases)
- [Commits](https://github.com/cohere-ai/cohere-typescript/compare/7.14.0...7.17.1)

Updates `cron-parser` from 4.9.0 to 5.2.0
- [Release notes](https://github.com/harrisiirak/cron-parser/releases)
- [Commits](https://github.com/harrisiirak/cron-parser/compare/4.9.0...v5.2.0)

Updates `date-fns` from 3.6.0 to 4.1.0
- [Release notes](https://github.com/date-fns/date-fns/releases)
- [Changelog](https://github.com/date-fns/date-fns/blob/main/CHANGELOG.md)
- [Commits](https://github.com/date-fns/date-fns/compare/v3.6.0...v4.1.0)

Updates `dotenv` from 16.4.5 to 16.5.0
- [Changelog](https://github.com/motdotla/dotenv/blob/master/CHANGELOG.md)
- [Commits](https://github.com/motdotla/dotenv/compare/v16.4.5...v16.5.0)

Updates `dotenv-cli` from 7.4.2 to 8.0.0
- [Release notes](https://github.com/entropitor/dotenv-cli/releases)
- [Commits](https://github.com/entropitor/dotenv-cli/compare/v7.4.2...v8.0.0)

Updates `express` from 4.19.2 to 5.1.0
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...v5.1.0)

Updates `@types/express` from 4.17.21 to 5.0.2
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/express)

Updates `express-rate-limit` from 7.3.1 to 7.5.0
- [Release notes](https://github.com/express-rate-limit/express-rate-limit/releases)
- [Commits](https://github.com/express-rate-limit/express-rate-limit/compare/v7.3.1...v7.5.0)

Updates `glob` from 10.4.2 to 11.0.2
- [Changelog](https://github.com/isaacs/node-glob/blob/main/changelog.md)
- [Commits](https://github.com/isaacs/node-glob/compare/v10.4.2...v11.0.2)

Updates `ioredis` from 5.4.1 to 5.6.1
- [Release notes](https://github.com/luin/ioredis/releases)
- [Changelog](https://github.com/redis/ioredis/blob/main/CHANGELOG.md)
- [Commits](https://github.com/luin/ioredis/compare/v5.4.1...v5.6.1)

Updates `jsdom` from 26.0.0 to 26.1.0
- [Release notes](https://github.com/jsdom/jsdom/releases)
- [Changelog](https://github.com/jsdom/jsdom/blob/main/Changelog.md)
- [Commits](https://github.com/jsdom/jsdom/compare/26.0.0...26.1.0)

Updates `json-schema-to-zod` from 2.3.0 to 2.6.1
- [Commits](https://github.com/StefanTerdell/json-schema-to-zod/commits)

Updates `koffi` from 2.9.0 to 2.11.0
- [Commits](https://github.com/Koromix/koffi/commits)

Updates `luxon` from 3.4.4 to 3.6.1
- [Changelog](https://github.com/moment/luxon/blob/master/CHANGELOG.md)
- [Commits](https://github.com/moment/luxon/compare/3.4.4...3.6.1)

Updates `mammoth` from 1.7.2 to 1.9.1
- [Release notes](https://github.com/mwilliamson/mammoth.js/releases)
- [Changelog](https://github.com/mwilliamson/mammoth.js/blob/master/NEWS)
- [Commits](https://github.com/mwilliamson/mammoth.js/compare/1.7.2...1.9.1)

Updates `marked` from 14.1.2 to 15.0.12
- [Release notes](https://github.com/markedjs/marked/releases)
- [Changelog](https://github.com/markedjs/marked/blob/master/.releaserc.json)
- [Commits](https://github.com/markedjs/marked/compare/v14.1.2...v15.0.12)

Updates `mongoose` from 8.4.4 to 8.15.1
- [Release notes](https://github.com/Automattic/mongoose/releases)
- [Changelog](https://github.com/Automattic/mongoose/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Automattic/mongoose/compare/8.4.4...8.15.1)

Updates `natural` from 7.0.7 to 8.1.0
- [Release notes](https://github.com/NaturalNode/natural/releases)
- [Commits](https://github.com/NaturalNode/natural/compare/v7.0.7...v8.1.0)

Updates `posthog-node` from 4.0.1 to 4.18.0
- [Release notes](https://github.com/PostHog/posthog-js-lite/releases)
- [Changelog](https://github.com/PostHog/posthog-js-lite/blob/main/posthog-node/CHANGELOG.md)
- [Commits](https://github.com/PostHog/posthog-js-lite/commits/posthog-node-v4.18.0/posthog-node)

Updates `puppeteer` from 22.12.1 to 24.10.0
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/puppeteer/puppeteer/compare/puppeteer-v22.12.1...puppeteer-v24.10.0)

Updates `rate-limiter-flexible` from 2.4.2 to 7.1.1
- [Release notes](https://github.com/animir/node-rate-limiter-flexible/releases)
- [Commits](https://github.com/animir/node-rate-limiter-flexible/commits/v7.1.1)

Updates `resend` from 3.4.0 to 4.5.1
- [Release notes](https://github.com/resendlabs/resend-node/releases)
- [Commits](https://github.com/resendlabs/resend-node/commits)

Updates `stripe` from 16.1.0 to 18.2.1
- [Release notes](https://github.com/stripe/stripe-node/releases)
- [Changelog](https://github.com/stripe/stripe-node/blob/master/CHANGELOG.md)
- [Commits](https://github.com/stripe/stripe-node/compare/v16.1.0...v18.2.1)

Updates `supabase` from 1.172.2 to 2.23.4
- [Release notes](https://github.com/supabase/cli/releases)
- [Changelog](https://github.com/supabase/cli/blob/develop/.goreleaser.yml)
- [Commits](https://github.com/supabase/cli/compare/v1.172.2...v2.23.4)

Updates `systeminformation` from 5.22.11 to 5.27.1
- [Changelog](https://github.com/sebhildebrandt/systeminformation/blob/master/CHANGELOG.md)
- [Commits](https://github.com/sebhildebrandt/systeminformation/compare/v5.22.11...v5.27.1)

Updates `tldts` from 6.1.75 to 7.0.8
- [Release notes](https://github.com/remusao/tldts/releases)
- [Changelog](https://github.com/remusao/tldts/blob/master/CHANGELOG.md)
- [Commits](https://github.com/remusao/tldts/compare/v6.1.75...v7.0.8)

Updates `typesense` from 1.8.2 to 2.0.3
- [Release notes](https://github.com/typesense/typesense-js/releases)
- [Commits](https://github.com/typesense/typesense-js/compare/v1.8.2...v2.0.3)

Updates `undici` from 6.20.1 to 7.10.0
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v6.20.1...v7.10.0)

Updates `unstructured-client` from 0.11.3 to 0.24.4
- [Release notes](https://github.com/Unstructured-IO/unstructured-js-client/releases)
- [Changelog](https://github.com/Unstructured-IO/unstructured-js-client/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Unstructured-IO/unstructured-js-client/compare/v0.11.3...v0.24.4)

Updates `uuid` from 10.0.0 to 11.1.0
- [Release notes](https://github.com/uuidjs/uuid/releases)
- [Changelog](https://github.com/uuidjs/uuid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/uuidjs/uuid/compare/v10.0.0...v11.1.0)

Updates `winston` from 3.14.2 to 3.17.0
- [Release notes](https://github.com/winstonjs/winston/releases)
- [Changelog](https://github.com/winstonjs/winston/blob/master/CHANGELOG.md)
- [Commits](https://github.com/winstonjs/winston/compare/v3.14.2...v3.17.0)

Updates `winston-transport` from 4.8.0 to 4.9.0
- [Release notes](https://github.com/winstonjs/winston-transport/releases)
- [Changelog](https://github.com/winstonjs/winston-transport/blob/master/CHANGELOG.md)
- [Commits](https://github.com/winstonjs/winston-transport/compare/v4.8.0...v4.9.0)

Updates `ws` from 8.18.0 to 8.18.2
- [Release notes](https://github.com/websockets/ws/releases)
- [Commits](https://github.com/websockets/ws/compare/8.18.0...8.18.2)

Updates `@types/ws` from 8.5.12 to 8.18.1
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/ws)

Updates `zod` from 3.24.2 to 3.25.48
- [Release notes](https://github.com/colinhacks/zod/releases)
- [Commits](https://github.com/colinhacks/zod/compare/v3.24.2...v3.25.48)

---
updated-dependencies:
- dependency-name: "@ai-sdk/anthropic"
  dependency-version: 1.2.12
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@ai-sdk/deepinfra"
  dependency-version: 0.2.15
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@ai-sdk/fireworks"
  dependency-version: 0.2.14
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@ai-sdk/google"
  dependency-version: 1.2.18
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@ai-sdk/google-vertex"
  dependency-version: 2.2.23
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@ai-sdk/groq"
  dependency-version: 1.2.9
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@ai-sdk/openai"
  dependency-version: 1.3.22
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@anthropic-ai/sdk"
  dependency-version: 0.52.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: "@apidevtools/json-schema-ref-parser"
  dependency-version: 12.0.2
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: "@brillout/import"
  dependency-version: 0.2.6
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@bull-board/api"
  dependency-version: 6.9.6
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: "@bull-board/express"
  dependency-version: 6.9.6
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: "@dqbd/tiktoken"
  dependency-version: 1.0.21
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@nangohq/node"
  dependency-version: 0.59.13
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: "@openrouter/ai-sdk-provider"
  dependency-version: 0.7.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: "@sentry/cli"
  dependency-version: 2.46.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: "@sentry/node"
  dependency-version: 9.24.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: "@sentry/profiling-node"
  dependency-version: 9.24.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: "@supabase/supabase-js"
  dependency-version: 2.49.9
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: ai
  dependency-version: 4.3.16
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: ajv
  dependency-version: 8.17.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: async
  dependency-version: 3.2.6
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: axios
  dependency-version: 1.9.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: body-parser
  dependency-version: 2.2.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: bullmq
  dependency-version: 5.53.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: cacheable-lookup
  dependency-version: 7.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: cheerio
  dependency-version: 1.0.0
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: cohere-ai
  dependency-version: 7.17.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: cron-parser
  dependency-version: 5.2.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: date-fns
  dependency-version: 4.1.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: dotenv
  dependency-version: 16.5.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: dotenv-cli
  dependency-version: 8.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: express
  dependency-version: 5.1.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: "@types/express"
  dependency-version: 5.0.2
  dependency-type: direct:development
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: express-rate-limit
  dependency-version: 7.5.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: glob
  dependency-version: 11.0.2
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: ioredis
  dependency-version: 5.6.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: jsdom
  dependency-version: 26.1.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: json-schema-to-zod
  dependency-version: 2.6.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: koffi
  dependency-version: 2.11.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: luxon
  dependency-version: 3.6.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: mammoth
  dependency-version: 1.9.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: marked
  dependency-version: 15.0.12
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: mongoose
  dependency-version: 8.15.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: natural
  dependency-version: 8.1.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: posthog-node
  dependency-version: 4.18.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: puppeteer
  dependency-version: 24.10.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: rate-limiter-flexible
  dependency-version: 7.1.1
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: resend
  dependency-version: 4.5.1
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: stripe
  dependency-version: 18.2.1
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: supabase
  dependency-version: 2.23.4
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: systeminformation
  dependency-version: 5.27.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: tldts
  dependency-version: 7.0.8
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: typesense
  dependency-version: 2.0.3
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: undici
  dependency-version: 7.10.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: unstructured-client
  dependency-version: 0.24.4
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: uuid
  dependency-version: 11.1.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: prod-deps
- dependency-name: winston
  dependency-version: 3.17.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: winston-transport
  dependency-version: 4.9.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: ws
  dependency-version: 8.18.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: prod-deps
- dependency-name: "@types/ws"
  dependency-version: 8.18.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
- dependency-name: zod
  dependency-version: 3.25.48
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: prod-deps
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-06-02 20:39:45 +00:00
Gergő Móricz
7a8be13220 remove indexes that are no longer used 2025-06-02 22:09:55 +02:00
Gergő Móricz
98ceda9bd5
feat(search): ignore concurrency limit for search (FIR-2187) (#1617) 
* feat(search): ignore concurrency limit for search (temp)

* feat(search): only for low tier users for good DX
 2025-06-02 17:07:44 -03:00
Gergő Móricz
1396451d31 bump rust version pt.2 2025-06-02 18:10:14 +02:00
Gergő Móricz
07fb651a91 bump rust version 2025-06-02 18:09:12 +02:00
Supasin Liulak
6a76ccfacb
webhook param for crawl (#1609) 2025-06-02 18:08:32 +02:00
Nicolas
9297afd1ff Nick: search 2025-05-29 17:00:13 -03:00
Gergő Móricz
a8e0482718 feat(search): bill for PDFs properly 2025-05-29 20:59:15 +02:00
Gergő Móricz
a2f41fb650 feat(api/server): wait 60s for GCE load balancer drain timeout 
To minimize 502s.
 2025-05-29 20:08:52 +02:00
Gergő Móricz
3ea221b093 fix(api/queue): tighten expiries on indexQueue jobs 2025-05-29 16:36:55 +02:00
Gergő Móricz
c9dd0e609a fix(api/queue): tighten expiries on billingQueue jobs 2025-05-29 16:26:52 +02:00
Gergő Móricz
93655b5c0b
feat(scrapeURL/pdf): bill n credits per page (FIR-1934) (#1553) 
* feat(scrapeURL/pdf): bill n credits per page

* Update scrape.ts

* Update queue-worker.ts

* separate billing logi

---------

Co-authored-by: Nicolas <nicolascamara29@gmail.com>
 2025-05-29 16:01:08 +02:00
Gergő Móricz
38c96b524f
feat(scrapeURL): handle contentType JSON better in markdown conversion (#1604) 2025-05-29 15:26:07 +02:00
Gergő Móricz
7e73b01599 fix(queue-worker): call webhook after job is in DB 2025-05-29 14:40:47 +02:00
Gergő Móricz
706d378a89 feat(api/v1/scrape-status): log supa lookup errors 2025-05-29 13:02:54 +02:00
Gergő Móricz
3557c90210
feat(js-sdk): auto mode proxy (FIR-2145) (#1602) 
* feat(js-sdk): auto mode proxy

* Nick: py sdk

---------

Co-authored-by: Nicolas <nicolascamara29@gmail.com>
 2025-05-28 14:31:48 -03:00
Gergő Móricz
a5efff07f9
feat(apps/api): add support for a separate, non-eviction Redis (#1600) 
* feat(apps/api): add support for a separate, non-eviction Redis

* fix: misimport
 2025-05-28 09:58:04 +02:00
Nicolas
756b452a01 Update batch_billing.ts 2025-05-27 19:05:00 -03:00
Nicolas
299e3e29e0 Update batch_billing.ts 2025-05-27 18:44:24 -03:00
Gergő Móricz
a36c6a4f40
feat(scrapeURL): add unnormalizedSourceURL for url matching DX (FIR-2137) (#1601) 
* feat(scrapeURL): add unnormalizedSourceURL for url matching DX

* fix(tests): fixc
 2025-05-27 21:33:44 +02:00
Gergő Móricz
474e5a0543 fix(crawler): always set expiry on sitemap links in redis 2025-05-27 15:39:31 +02:00
Gergő Móricz
c3738063cf less logs even more 2025-05-25 15:50:20 +02:00
Gergő Móricz
492d97e889 reduce logging 2025-05-24 00:09:13 +02:00
Gergő Móricz
a3145ccacc
fix(extract-status): be able to get extract status even after TTL lapses (#1599) 2025-05-23 22:33:09 +02:00
Gergő Móricz
8389a1a78d
fix(html-transformer): bad outName for og:locale:alternate (FIR-2101) (#1597) 
* fix(html-transformer): bad outName for og:locale:alternate

* oops
 2025-05-23 17:10:09 +02:00
Gergő Móricz
3ec17e2d1a
fix(v1): avoid overwriting rateLimiterMode with FIRE-1 rate limiter (#1593) 2025-05-23 11:50:59 -03:00
Gergő Móricz
3df687e4db
feat(queue-worker/afterJobDone): improved ccq insert logic (#1595) 2025-05-23 11:50:14 -03:00
Gergő Móricz
a7894a2714 fix(scrapeURL/pdf): even better timeout detection 2025-05-23 16:29:28 +02:00
Gergő Móricz
8571b5a99d Revert "feat(queue-worker/afterJobDone): improved ccq insert logic" 
This reverts commit 97c635676d228ed1342cdd1468cb2a1aef4fcfc9.
 2025-05-23 15:42:15 +02:00
Gergő Móricz
97c635676d feat(queue-worker/afterJobDone): improved ccq insert logic 2025-05-23 15:41:57 +02:00
Gergő Móricz
f41af8241e fix(scrapeURL/pdf): better timeout error 2025-05-23 13:59:53 +02:00
Gergő Móricz
bfe731309c fix(scrapeURL/pdf/mu): remove log 2025-05-23 13:47:34 +02:00
Gergő Móricz
b03670a8b7
feat: parse PDFs on fc side and reject if too long for timeout (FIR-2083) (#1592) 
* feat: pdf-parser, implementation in scrapeURL

* use pdf-parser for page count instead of mu

* fix(pdf-parser): bindings

* feat(scrapeURL/pdf): adjust MILLISECONDS_PER_PAGE

* implement post-runsync polling and fix

* fix(Dockerfile): copy in the pdf-parser source code

* fix(scrapeURL/pdf): better error for timeout below 0
 2025-05-23 13:45:53 +02:00
Gergő Móricz
321fff1695 ok what 2025-05-23 11:41:34 +02:00
Gergő Móricz
00cc733972 more logs 2025-05-23 11:29:34 +02:00
Gergő Móricz
bb67b9812b check if enum is being overwritten somehow 2025-05-23 11:27:49 +02:00
Gergő Móricz
d4e7bde03d add stack 2025-05-23 10:18:30 +02:00
Gergő Móricz
6776292cc2 more log 2025-05-23 09:57:15 +02:00
Gergő Móricz
2e863da334 feat(api/v1/authMiddleware): add log to debug extract agent preview mode 2025-05-23 09:35:29 +02:00
Gergő Móricz
3e736f1e0d
feat(concurrency-log): add cclog endpoint (FIR-2067) (#1589) 
* feat(concurrency-log): add cclog endpoint

* fix(api/routes/admin): misimport

* more misimports
 2025-05-22 18:13:35 -03:00
Gergő Móricz
fd74299134
feat(scrapeURL, logJob): log pdf page count to db (FIR-2068) (#1587) 
* feat(scrapeURL, logJob): log pdf page count to db

* devin stop the test littering pls
 2025-05-22 17:26:01 -03:00
Gergő Móricz
cc2c968425
fix(robustFetch): selective logging (#1588) 2025-05-22 17:23:49 -03:00
Gergő Móricz
749d89a551
feat(api/v1/extract): ignoreInvalidURLs (#1585) 2025-05-21 21:46:55 -03:00
Gergő Móricz
6478754f1b
feat(api/extract): show extract as origin for scrapes originating from it (#1584) 2025-05-21 21:45:44 -03:00
Gergő Móricz
8522103228 feat(api/v1/extract): log requests 2025-05-21 23:25:32 +02:00
Gergő Móricz
938ef1cfb2 feat(api/v1/map): log requests 2025-05-21 23:00:43 +02:00
Gergő Móricz
a3aee9be13
fix(queue-worker): finish crawl if all addable URLs were already locked (#1582) 2025-05-21 17:40:31 -03:00
Gergő Móricz
9bb97388e2
feat(search): ignoreBlockedURLs (FIR-1954) (#1580) 
* feat(search): ignoreBlockedURLs

* change name
 2025-05-21 13:02:58 -03:00
Gergő Móricz
3d4692f47c
Update SELF_HOST.md 2025-05-21 17:50:26 +02:00
devin-ai-integration[bot]
c7bb9e77ab
docs: add MAX_RAM and MAX_CPU environment variables documentation (#1581) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: mogery@sideguide.dev <mogery@sideguide.dev>
 2025-05-21 17:49:16 +02:00