Ademílson F. Tonato
843cec971d
[FIR-796] feat(api/types): Add action and wait time validation for scrape requests
...
- Implement max actions limit (15 actions)
- Add total wait time calculation for actions
- Increase max waitFor time to 60 seconds
- Refactor scrape options schema to include validation
2025-02-07 21:16:38 +00:00
Nicolas
34adf43200
Merge branch 'main' into feat/go-html-to-md-parser
2024-09-05 12:13:14 -03:00
rafaelsideguide
cb8571abad
fix: enforced dotenv config
2024-09-04 15:57:57 -03:00
rafaelsideguide
291d9e375b
now using compiled go/C lib with koffi
2024-09-03 10:56:07 -03:00
Nicolas
08a9cb8db4
Merge branch 'main' into pr/516
2024-09-02 23:32:23 -03:00
Gergő Móricz
f4466f6bb0
fix(test-suite): add artillery
2024-08-14 19:33:09 +02:00
rafaelsideguide
bbed6ef23d
added validation on every USE_DB_AUTHENTICATION call
2024-08-12 14:20:41 -03:00
rafaelsideguide
e0954d7f59
Merge branch 'main' of https://github.com/mendableai/firecrawl
2024-07-25 17:48:43 -03:00
rafaelsideguide
81aa919262
fix
2024-07-25 17:47:43 -03:00
rafaelsideguide
309728a482
updated logs
2024-07-25 09:48:06 -03:00
rafaelsideguide
a2cdc520e6
dependabot for security checks, fixed crawl test
2024-07-05 14:49:03 -03:00
dependabot[bot]
ad3e73b445
apps/test-suite(deps): bump the prod-deps group
...
Bumps the prod-deps group in /apps/test-suite with 6 updates:
| Package | From | To |
| --- | --- | --- |
| [@anthropic-ai/sdk](https://github.com/anthropics/anthropic-sdk-typescript ) | `0.20.8` | `0.24.3` |
| [@dqbd/tiktoken](https://github.com/dqbd/tiktoken ) | `1.0.14` | `1.0.15` |
| [@supabase/supabase-js](https://github.com/supabase/supabase-js ) | `2.43.1` | `2.44.2` |
| [openai](https://github.com/openai/openai-node ) | `4.40.2` | `4.52.2` |
| [playwright](https://github.com/microsoft/playwright ) | `1.43.1` | `1.45.0` |
| [ts-jest](https://github.com/kulshekhar/ts-jest ) | `29.1.2` | `29.1.5` |
Updates `@anthropic-ai/sdk` from 0.20.8 to 0.24.3
- [Release notes](https://github.com/anthropics/anthropic-sdk-typescript/releases )
- [Changelog](https://github.com/anthropics/anthropic-sdk-typescript/blob/main/CHANGELOG.md )
- [Commits](https://github.com/anthropics/anthropic-sdk-typescript/compare/sdk-v0.20.8...sdk-v0.24.3 )
Updates `@dqbd/tiktoken` from 1.0.14 to 1.0.15
- [Release notes](https://github.com/dqbd/tiktoken/releases )
- [Changelog](https://github.com/dqbd/tiktoken/blob/main/CHANGELOG.md )
- [Commits](https://github.com/dqbd/tiktoken/compare/@dqbd/tiktoken@1.0.14...@dqbd/tiktoken@1.0.15 )
Updates `@supabase/supabase-js` from 2.43.1 to 2.44.2
- [Release notes](https://github.com/supabase/supabase-js/releases )
- [Changelog](https://github.com/supabase/supabase-js/blob/master/RELEASE.md )
- [Commits](https://github.com/supabase/supabase-js/compare/v2.43.1...v2.44.2 )
Updates `openai` from 4.40.2 to 4.52.2
- [Release notes](https://github.com/openai/openai-node/releases )
- [Changelog](https://github.com/openai/openai-node/blob/master/CHANGELOG.md )
- [Commits](https://github.com/openai/openai-node/compare/v4.40.2...v4.52.2 )
Updates `playwright` from 1.43.1 to 1.45.0
- [Release notes](https://github.com/microsoft/playwright/releases )
- [Commits](https://github.com/microsoft/playwright/compare/v1.43.1...v1.45.0 )
Updates `ts-jest` from 29.1.2 to 29.1.5
- [Release notes](https://github.com/kulshekhar/ts-jest/releases )
- [Changelog](https://github.com/kulshekhar/ts-jest/blob/main/CHANGELOG.md )
- [Commits](https://github.com/kulshekhar/ts-jest/compare/v29.1.2...v29.1.5 )
---
updated-dependencies:
- dependency-name: "@anthropic-ai/sdk"
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: prod-deps
- dependency-name: "@dqbd/tiktoken"
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: prod-deps
- dependency-name: "@supabase/supabase-js"
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: prod-deps
- dependency-name: openai
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: prod-deps
- dependency-name: playwright
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: prod-deps
- dependency-name: ts-jest
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: prod-deps
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-07-02 12:47:58 +00:00
rafaelsideguide
a20d002a6b
Delete test-run-report.json
2024-06-17 09:25:29 -03:00
rafaelsideguide
7ca431b202
crawl load tests 7 and 8
2024-05-23 16:36:05 -03:00
rafaelsideguide
aa6df4305e
crawl load tests 6 and 7
2024-05-22 18:20:24 -03:00
rafaelsideguide
ff147f1f51
load testing for crawl
2024-05-22 14:26:29 -03:00
rafaelsideguide
068a240ab4
load tests for scrape route
2024-05-22 09:30:32 -03:00
rafaelsideguide
75f4e34d8e
Merge branch 'main' into test/load-testing
2024-05-21 10:28:02 -03:00
rafaelsideguide
6a3ac13fe1
Update load-test.yml
2024-05-21 10:06:02 -03:00
rafaelsideguide
d667e1417b
added fly staging load test
...
- being rate limited. Need to add the token to the rate-limit functions
2024-05-17 19:09:19 -03:00
rafaelsideguide
7297b21dcd
Added load testing using artillery
2024-05-17 18:32:44 -03:00
Nicolas
24be4866c5
Nick:
2024-05-15 17:16:20 -07:00
Nicolas
ade4e05cff
Nick: working
2024-05-15 17:13:04 -07:00
Nicolas
bfccaf670d
Nick: fixes most of it
2024-05-15 15:30:37 -07:00
rafaelsideguide
d91043376c
not working yet
2024-05-15 18:54:40 -03:00
rafaelsideguide
fa014defc7
Fixing child links only bug
2024-05-15 18:35:09 -03:00
rafaelsideguide
da8d94105d
fixed for testing the crawl algorithm only
2024-05-15 17:16:03 -03:00
Nicolas
95ffaa2236
Update crawl.test.ts
2024-05-15 12:58:02 -07:00
Nicolas
f15b8f855e
Update crawl.json
2024-05-15 12:57:24 -07:00
Nicolas
98dd672d0a
Update crawl.json
2024-05-15 12:55:04 -07:00
Nicolas
499671c87f
Update crawl.test.ts
2024-05-15 12:50:13 -07:00
Nicolas
4745d114be
Update crawl.test.ts
2024-05-15 12:42:14 -07:00
Nicolas
1601e93d69
Merge branch 'main' into test/crawl-options
2024-05-15 12:34:47 -07:00
Nicolas
fd82982a31
Nick:
2024-05-15 12:11:16 -07:00
rafaelsideguide
4925ee59f6
added crawl test suite
2024-05-15 15:50:50 -03:00
Nicolas
9541ff6b30
Nick: 429 addressed
2024-05-08 15:14:39 -07:00
Nicolas
3bfef646e0
Update index.test.ts
2024-05-08 13:23:53 -07:00
Nicolas
6ced8e73a7
Update index.test.ts
2024-05-08 13:13:38 -07:00
Nicolas
c50076c377
Update websites.json
2024-05-08 13:04:17 -07:00
Nicolas
1296928879
Update index.test.ts
2024-05-08 13:00:20 -07:00
Nicolas
fb7a8fd73f
Delete test_screenshot.png
2024-05-08 12:39:32 -07:00
Nicolas
c635688ddb
Nick: test suite
2024-05-08 12:36:54 -07:00
Nicolas
d34b4de6ac
Update websites.json
2024-05-08 12:27:45 -07:00
Nicolas
a0a67f124a
Update index.test.ts
2024-05-08 12:26:04 -07:00
Nicolas
b7e3104c7b
Ni
2024-05-08 12:18:53 -07:00
Nicolas
ad58bc2820
Nick: test suite init
2024-05-08 11:38:46 -07:00
rafaelsideguide
fbb4c63a1a
[Test] Added integration tests suite
...
solves #15
2024-05-03 17:23:25 -03:00
