2223 Commits

Author	SHA1	Message	Date
Gergő Móricz	f0e0d3e2e3	fix(api): crawl origin tracking (FIR-1499)	2025-03-28 12:47:37 +01:00
Gergő Móricz	46048bc94d	feat(scrapeURL): return js returns from f-e (FIR-1535) (#1385) ... * feat(scrapeURL): return js returns from f-e * feat(js-sdk): handle new results	2025-03-28 12:42:25 +01:00
Gergő Móricz	e799cf206b	increase manual rl	2025-03-26 20:13:32 +01:00
Gergő Móricz	2b39788d73	manual rl	2025-03-26 20:00:25 +01:00
Gergő Móricz	42236ef0f0	feat(admin/check-fire-engine): better logging	2025-03-25 20:51:40 +01:00
Gergő Móricz	e8f27bef08	feat(rate-limiter): manual_etier2c	2025-03-25 16:24:01 +01:00
Nicolas	a50dc106ef	(feat/deep-research) Deep Research Alpha v1 - Structured Outputs + Customizability (#1365) ... * Nick: * Nick: structured output support * Nick: support for zod and pydantic	2025-03-24 20:13:52 +04:00
Gergő Móricz	5e35782b5d	update acuc	2025-03-20 17:47:29 +01:00
Nicolas	867e545511	Update rate-limiter.ts	2025-03-19 23:25:05 -04:00
Nicolas	3e0d3db90e	Update rate-limiter.ts	2025-03-19 23:20:18 -04:00
Gergő Móricz	0bdaa97bfb	acuc fix	2025-03-19 21:10:52 +01:00
Gergő Móricz	6dc5b1cd64	feat(auth): acuc update	2025-03-19 17:39:59 +01:00
Nicolas	e97a279efe	Nick: let user format the analysis (#1351)	2025-03-18 15:51:40 -04:00
Gergő Móricz	d0b468ee7b	feat(scrape/actions/click): add all parameter (FIR-1443) (#1342) ... * feat(scrape/actions/click): add all parameter * bump sdk	2025-03-17 20:47:17 +01:00
Gergő Móricz	d12feaea52	fix(crawl): allow execution time longer than 24h	2025-03-17 18:04:23 +01:00
Nicolas	20c93db43f	(feat/extract) URLs can now be optional in /extract (#1346) ... * Nick: urls optional on extract * Update index.ts	2025-03-16 22:29:25 -04:00
Gergő Móricz	200de9e7e7	feat(scrape): add warning to document if it was concurrency limited (#1348) ... * feat(scrape): add warning to document if it was concurrency limited * phrasing + test fix	2025-03-16 19:57:27 +01:00
Gergő Móricz	670ca84ae9	fix(v1/checkCredits): snap crawl limit to remaining credits if over without erroring out (#1350)	2025-03-16 19:57:08 +01:00
Gergő Móricz	87ad53e727	fix(api/tests/snips/billing): bump timeout	2025-03-16 16:37:11 +01:00
Eric Ciarla	180770f1a3	init and final (#1349)	2025-03-16 16:16:35 +01:00
Gergő Móricz	bad822421f	fix(v1/scrape): make log show up in queries	2025-03-16 16:04:25 +01:00
Gergő Móricz	611c2d9c83	feat(v1/scrape): add further logging to document scrape bugs better	2025-03-16 16:02:53 +01:00
Gergő Móricz	c3ebfafba7	fix(llmExtract): remove unsupported JSON schema properties (#1335)	2025-03-13 20:10:39 +01:00
Gergő Móricz	387dd3aa38	fix(tests/snips/billing): don't wait 40s for nothing when self hosted	2025-03-13 20:07:52 +01:00
Gergő Móricz	c7ae50d2d0	fix(crawler): sitemaps poisoning crawls with unrelated links (#1334)	2025-03-13 19:31:05 +01:00
Dominik Farr	da6b7505f3	Meaningful log message for high resource usage errors	2025-03-13 11:08:04 -07:00
Nicolas	c6cad942ab	Nick: errors -> warn	2025-03-13 13:07:51 -04:00
Nicolas	7ec278a908	Nick: fixes	2025-03-13 13:05:12 -04:00
Nicolas	134de67a3b	(fix/map) Map failed to filter by path if indexed (#1333) ... * Nick: * Update map.ts * Update map.ts	2025-03-13 12:48:56 -04:00
Gergő Móricz	f87e11712c	fix: don't log bull secret	2025-03-13 17:30:37 +01:00
Loris	c53df8650a	Update searxng.ts (#1319) ... remove default categories. otherwise we cannot use engines	2025-03-13 17:21:44 +01:00
Nicolas	d54af97754	Update rate-limiter.ts	2025-03-12 21:57:50 -04:00
Nicolas	b87b0d9b7f	Merge branch 'nsc/concurrent-browsers'	2025-03-12 20:21:26 -04:00
Nicolas	e886189394	Update search.ts	2025-03-12 20:21:19 -04:00
Nicolas	1e6b484add	(feat/pricing) Concurrent Browsers - Improve rate limits (#1331) ... * Update rate-limiter.ts * Update rate-limiter.ts	2025-03-12 15:23:09 -04:00
Nicolas	d438b235f6	Update rate-limiter.ts	2025-03-12 15:22:28 -04:00
Gergő Móricz	71b6b83ec2	tally rework api switchover (#1328) ... * tally rework api switchover * fix and send logs * temp: force main instance while RPCs propagate * Revert "temp: force main instance while RPCs propagate" This reverts commit 4c93379cfa64efd60eb4767dd8eced1bdd302531.	2025-03-12 20:10:33 +01:00
Nicolas	9edbdc987f	Update rate-limiter.ts	2025-03-12 14:17:22 -04:00
Gergő Móricz	7cf2e52fe6	feat(crawl): add maxDiscoveryDepth (#1329)	2025-03-12 18:46:57 +01:00
Gergő Móricz	d855f5a567	fix(test/snips/scrape): allow more time for stealth proxy	2025-03-12 18:22:40 +01:00
Gergő Móricz	337bc261f7	temp: remove flakey ad-block tests	2025-03-12 18:17:52 +01:00
Abdul Rahman ArM	e9804d25f9	fix: resolve circular JSON structure error in search function (#1330) ... Modified error handlers to avoid logging entire response objects that contain circular references	2025-03-12 18:13:53 +01:00
Nicolas	4cc33e1e8d	Nick: added team_id_o	2025-03-10 22:30:26 -04:00
Gergő Móricz	0c457e6f2f	adjust acuc balance	2025-03-07 20:34:43 +01:00
rafaelmmiller	3786ad7f5d	restart	2025-03-07 16:19:59 -03:00
Nicolas	1ced546bd0	Update rate-limiter.ts	2025-03-06 19:17:02 -03:00
Nicolas	f45b3c0155	Merge branch 'main' into fix/preview_token	2025-03-06 19:02:29 -03:00
Nicolas	b66e0ccb7d	Nick:	2025-03-06 18:36:01 -03:00
rafaelmmiller	55a4a3d768	preview-token	2025-03-06 18:16:07 -03:00
Gergő Móricz	39b1390289	fix: crawl	2025-03-06 21:57:42 +01:00