1992 Commits

Author	SHA1	Message	Date
Nicolas	f45fa12075	Update rate-limiter.ts	2025-04-05 12:42:24 -04:00
Nicolas	41e094032f	Update email_notification.ts	2025-04-04 14:36:41 -04:00
Nicolas	e1e39f8836	Nick: send notifications for crawl+batch scrape	2025-04-04 14:34:48 -04:00
Ademílson F. Tonato	426151c9c9	feat(queue-jobs): add function to determine job type and update notification logic for concurrency limits	2025-04-03 17:02:51 +01:00
Gergő Móricz	8c1579df51	bump cc	2025-04-03 11:56:24 +02:00
Gergő Móricz	2e2c3d52ce	feat: add swoogo classes to force include main tags	2025-04-03 09:57:19 +02:00
Gergő Móricz	24f5199359	compare format (FIR-1560) (#1405)	2025-04-02 19:52:43 +02:00
Gergő Móricz	b3b63486f1	cc manual	2025-04-02 19:27:13 +02:00
Ademílson F. Tonato	b900f34b5a	feat(notification): add notification message for concurrency limit reached	2025-04-02 17:36:11 +01:00
rafaelmmiller	7216799ca0	revert mog changes	2025-04-02 10:45:11 -03:00
Ademílson Tonato	73a297d6c8	Merge pull request #1398 from mendableai/refactor/email-concurrency-limit-reached ... feat(queue-jobs): update notification logic for concurrency limits and add parameter (jsdocs) to batchScrapeUrls	2025-04-02 11:18:18 +01:00
Ademílson F. Tonato	7468464552	feat(queue-jobs): implement conditional notification for concurrency limits based on team subscription status	2025-04-01 19:50:26 +01:00
Nicolas	ee211132c8	Nick:	2025-04-01 21:06:27 +04:00
Nicolas	c4255f4fdd	Update auth.ts	2025-04-01 21:00:40 +04:00
Nicolas	b79b90fdd1	Update auth.ts	2025-04-01 20:53:43 +04:00
Ademílson F. Tonato	58e587d99e	feat(queue-jobs): update notification logic for concurrency limits and add parameter (jsdocs) to batchScrapeUrls	2025-03-31 13:27:36 +01:00
Gergő Móricz	e0a3c54967	new acuc	2025-03-30 17:32:24 +02:00
Gergő Móricz	b9dde3fc3d	temp: move more to main instance	2025-03-29 18:18:55 +01:00
Gergő Móricz	4f0510e71d	temp: switch over crawl fetches to main instance	2025-03-29 18:05:50 +01:00
Gergő Móricz	f0e0d3e2e3	fix(api): crawl origin tracking (FIR-1499)	2025-03-28 12:47:37 +01:00
Gergő Móricz	46048bc94d	feat(scrapeURL): return js returns from f-e (FIR-1535) (#1385) ... * feat(scrapeURL): return js returns from f-e * feat(js-sdk): handle new results	2025-03-28 12:42:25 +01:00
Gergő Móricz	e799cf206b	increase manual rl	2025-03-26 20:13:32 +01:00
Gergő Móricz	2b39788d73	manual rl	2025-03-26 20:00:25 +01:00
Gergő Móricz	42236ef0f0	feat(admin/check-fire-engine): better logging	2025-03-25 20:51:40 +01:00
Gergő Móricz	e8f27bef08	feat(rate-limiter): manual_etier2c	2025-03-25 16:24:01 +01:00
Nicolas	a50dc106ef	(feat/deep-research) Deep Research Alpha v1 - Structured Outputs + Customizability (#1365) ... * Nick: * Nick: structured output support * Nick: support for zod and pydantic	2025-03-24 20:13:52 +04:00
Gergő Móricz	5e35782b5d	update acuc	2025-03-20 17:47:29 +01:00
Nicolas	867e545511	Update rate-limiter.ts	2025-03-19 23:25:05 -04:00
Nicolas	3e0d3db90e	Update rate-limiter.ts	2025-03-19 23:20:18 -04:00
Gergő Móricz	0bdaa97bfb	acuc fix	2025-03-19 21:10:52 +01:00
Gergő Móricz	6dc5b1cd64	feat(auth): acuc update	2025-03-19 17:39:59 +01:00
Nicolas	e97a279efe	Nick: let user format the analysis (#1351)	2025-03-18 15:51:40 -04:00
Gergő Móricz	d0b468ee7b	feat(scrape/actions/click): add all parameter (FIR-1443) (#1342) ... * feat(scrape/actions/click): add all parameter * bump sdk	2025-03-17 20:47:17 +01:00
Gergő Móricz	d12feaea52	fix(crawl): allow execution time longer than 24h	2025-03-17 18:04:23 +01:00
Nicolas	20c93db43f	(feat/extract) URLs can now be optional in /extract (#1346) ... * Nick: urls optional on extract * Update index.ts	2025-03-16 22:29:25 -04:00
Gergő Móricz	200de9e7e7	feat(scrape): add warning to document if it was concurrency limited (#1348) ... * feat(scrape): add warning to document if it was concurrency limited * phrasing + test fix	2025-03-16 19:57:27 +01:00
Gergő Móricz	670ca84ae9	fix(v1/checkCredits): snap crawl limit to remaining credits if over without erroring out (#1350)	2025-03-16 19:57:08 +01:00
Gergő Móricz	87ad53e727	fix(api/tests/snips/billing): bump timeout	2025-03-16 16:37:11 +01:00
Eric Ciarla	180770f1a3	init and final (#1349)	2025-03-16 16:16:35 +01:00
Gergő Móricz	bad822421f	fix(v1/scrape): make log show up in queries	2025-03-16 16:04:25 +01:00
Gergő Móricz	611c2d9c83	feat(v1/scrape): add further logging to document scrape bugs better	2025-03-16 16:02:53 +01:00
Gergő Móricz	c3ebfafba7	fix(llmExtract): remove unsupported JSON schema properties (#1335)	2025-03-13 20:10:39 +01:00
Gergő Móricz	387dd3aa38	fix(tests/snips/billing): don't wait 40s for nothing when self hosted	2025-03-13 20:07:52 +01:00
Gergő Móricz	c7ae50d2d0	fix(crawler): sitemaps poisoning crawls with unrelated links (#1334)	2025-03-13 19:31:05 +01:00
Dominik Farr	da6b7505f3	Meaningful log message for high resource usage errors	2025-03-13 11:08:04 -07:00
Nicolas	c6cad942ab	Nick: errors -> warn	2025-03-13 13:07:51 -04:00
Nicolas	7ec278a908	Nick: fixes	2025-03-13 13:05:12 -04:00
Nicolas	134de67a3b	(fix/map) Map failed to filter by path if indexed (#1333) ... * Nick: * Update map.ts * Update map.ts	2025-03-13 12:48:56 -04:00
Gergő Móricz	f87e11712c	fix: don't log bull secret	2025-03-13 17:30:37 +01:00
Loris	c53df8650a	Update searxng.ts (#1319) ... remove default categories. otherwise we cannot use engines	2025-03-13 17:21:44 +01:00