75 Commits

Author SHA1 Message Date
Srikanth Chekuri
77420b9d3a
chore: address some gaps in k8s monitoring (#6653) 2024-12-19 17:22:39 +05:30
Nityananda Gohain
64d46bc855
feat: support for scope in logs old and new qb (#6339) 2024-11-06 20:47:04 +05:30
Srikanth Chekuri
6448fb17e7
chore: update hosts list to use pre-aggregated data table dynamically (#6227) 2024-10-24 11:19:39 +05:30
Srikanth Chekuri
6c7167a224
chore: add missing shiftby in alert rule (#6239) 2024-10-24 02:20:32 +05:30
Nityananda Gohain
2b0da82f94
feat: move resource qb to its own package and use common options (#6238)
* feat: move resource qb to its own package and use common options

* fix: add remaining files

* fix: remove redundant struct
2024-10-22 16:46:58 +05:30
Nityananda Gohain
2230ca1740
fix: enrich attributes regardless if it is materialized (#6000)
* fix: enrich attributes regardless if it is materialized

* feat: take care of same key name with different type and datatype

* fix: makeLinks updated with new logic for logs

* fix: clean up PrepareFilters and make it generic
2024-10-09 20:03:26 +05:30
Srikanth Chekuri
4356ddae8c
chore: keep anomaly response sync with v4 query range (#6113) 2024-10-08 13:33:33 +05:30
Srikanth Chekuri
06a89b21da
chore: use mean of past, past2 and past3 seasons for growth (#5974) 2024-09-17 16:12:17 +05:30
Srikanth Chekuri
5698628839
chore: move some structs out of v3 (#5932) 2024-09-13 18:10:49 +05:30
Srikanth Chekuri
3596f73fb1
chore: add anomaly provider interface (#5856) 2024-09-13 18:06:20 +05:30
Nityananda Gohain
011b2167ba
Integrate V4 QB (#5914)
* feat: logsV4 initial refactoring

* feat: filter_query builder with tests added

* feat: all functions of v4 refactored

* fix: tests fixed

* feat: logs list API, logic update for better perf

* feat: integrate v4 qb

* fix: pass flag

* fix: update select for table panel

* fix: tests updated with better examples of limit and group by

* fix: resource filter support in live tail

* fix: v4 livetail api

* fix: changes for casting pointer value

* fix: reader options updated

* feat: cleanup and use flag

* feat: restrict new list api to single query

* fix: move getTsRanges to utils

* fix: address pr comments
2024-09-13 17:04:22 +05:30
Nityananda Gohain
6e7f04b492
logs v4 qb refactor (#5908)
* feat: logsV4 initial refactoring

* feat: filter_query builder with tests added

* feat: all functions of v4 refactored

* fix: tests fixed

* fix: update select for table panel

* fix: tests updated with better examples of limit and group by

* fix: resource filter support in live tail

---------

Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
2024-09-12 09:48:09 +05:30
Srikanth Chekuri
3e32dabf46
chore: alert state change and overall status (#5845) 2024-09-09 13:06:09 +05:30
Raj Kamal Singh
7844522691
Chore: qs filter suggestions: example queries for multiple top attributes (#5703)
* chore: put together helper for fetching values for multiple attributes

* chore: poc: use helper for filter suggestions

* chore: add a working impl for getting attrib values for multiple attributes

* chore: start updating integration test to account for new approach for getting log attrib values

* chore: use a global zap logger in filter suggestion tests

* chore: fix attrib values clickhouse query expectation

* chore: only query values for actual attributes when generating example queries

* chore: update clickhouse-go-mock

* chore: cleanup: separate params for attributesLimit and examplesLimit for filter suggestions

* chore: some test cleanup

* chore: some more cleanup

* chore: some more cleanup

---------

Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
2024-09-09 10:12:36 +05:30
Srikanth Chekuri
b798518aa9
chore: add total count and state filter (#5745) 2024-08-23 21:13:00 +05:30
Raj Kamal Singh
6c634b99d0
Feat: QS: query range progress api (#5671)
* feat: get query progress tracker started

* feat: flesh out query progress test some more and get first few assertions passing

* chore: flesh out query tracker tests and impl some more

* feat: add impl for QueryTracker.Subscribe

* feat: send latest update if available on subscription

* feat: broadcast query progress to all subscribers on update

* feat: finish plumbing query tracker happy path

* feat: finish with v0 impl for query progress tracker

* chore: some cleanup of query progress tracker

* feat: hook up query progress tracking for queryRangeV3

* feat: impl for query progress websocket API handler

* feat: implement Hijacker iface for loggingResponseWriter for websocket upgrades

* chore: some cleanup to query progress websocket API handler

* chore: some cleanup

* chore: move query progress impl into its own subpackage

* chore: separate in-memory tracker impl from interface

* chore: some more cleanup of in memory tracker

* chore: some more cleanup of query progress tracker

* chore: some final cleanups
2024-08-14 19:53:36 +05:30
Srikanth Chekuri
7811fdd17a
fix: nil pointer dereference for empty payload (#5680) 2024-08-12 21:43:38 +05:30
Srikanth Chekuri
0157b47424
chore: add empty labels to response (#5668) 2024-08-09 18:19:15 +05:30
Srikanth Chekuri
4489df6f39
feat: add runningDiff function (#5667) 2024-08-09 14:04:29 +05:30
Srikanth Chekuri
bb84960442
chore: add alerts state history query service impl (#5255) 2024-08-09 12:11:05 +05:30
Raj Kamal Singh
eb146491f2
Feat: QS: query builder suggestions api v0 (#5634)
* chore: stash initial work with API signature

* chore: put together setup for integration testing filter suggestions

* feat: filter suggestions: suggest attribs using existing autocomplete logic

* chore: filter suggestions test: add expectation for example queries

* feat: filter suggestions: default suggestions when data yet to be received

* feat: finish plumbing basic example queries

* chore: add test for filter suggestions with an existing query

* feat: filter suggestions: don't suggest attribs already included in existing filter

* chore: generate example queries by including existing filter first

* chore: upgrade ClickHouse-go-mock

* chore: some cleanup of reader.GetQBFilterSuggestionsForLogs

* chore: some cleanup of filter suggestion tests

* chore: some cleanup to http handler and request parsing logic for filter suggestions

* chore: remove expectation that attrib suggestions won't contain attribs already used in filter
2024-08-08 09:27:41 +05:30
Nityananda Gohain
1585065fff
fix: use proper indexes for full text search (#4787)
* fix: use proper indexes for full text search

* fix: tests updated

* feat: lower support only for body and not attributes

* fix: remove default tolower

* fix: add comment for json key split

* fix: remove ilike only for body searches

* fix: minor fixes

* fix: minor fixes
2024-07-22 17:46:35 +05:30
Srikanth Chekuri
326dec21fd
fix: use the correct formatter for the description (#5388) 2024-07-01 18:34:02 +05:30
Srikanth Chekuri
daa5a05677
chore: update table response format (#5349) 2024-06-26 14:34:27 +05:30
Srikanth Chekuri
52e0303997
fix: table order by with builder queries (#5308) 2024-06-25 13:42:40 +05:30
Nityananda Gohain
a4e98e565d
feat: sanitize query and remove groupBy for list panel query (#5285) 2024-06-19 15:40:34 +05:30
Srikanth Chekuri
1645523ae9
chore: add fill gaps for query range (#5155)
* chore: add fill gaps for query range

* chore: fix empty result
2024-06-11 19:58:52 +05:30
Srikanth Chekuri
6a829489a8
fix: remove the need for unnecessary dummy time column (#5108)
* fix: remove the need for unnecessary dummy time column

* chore: allow no timestamp

* chore: remove grouping sets
2024-06-05 19:33:45 +05:30
Srikanth Chekuri
1d1d85efa3
chore: default zero only for counters and label normalization (#5085) 2024-05-27 13:19:28 +05:30
Srikanth Chekuri
7e31b4ca01
fix: several issues (#5001) 2024-05-15 18:52:01 +05:30
Srikanth Chekuri
7d81bc3417
fix: value panel restriction should be on enabled queries (#4934) 2024-04-30 09:53:03 +05:30
Vishal Sharma
2bd666efae
fix: query range API validation (#4821) 2024-04-05 23:57:11 +05:30
Srikanth Chekuri
b3b7522250
chore: update APM metrics to use v4 query range (#4638) 2024-03-04 10:15:43 +05:30
Yunus M
1a62a13aea
chore: update query builder to support spatial aggregations and functions (#4569) 2024-03-01 14:51:50 +05:30
Srikanth Chekuri
f734142419
chore: add ExponentialHistogram support for metrics v4 query range (#4525) 2024-02-14 23:33:19 +05:30
Nityananda Gohain
0e331dd177
feat: support cache in logs (#4516)
* feat: support cache in logs

* fix: revert fluxinterval changes

* feat: support for limit queries

* feat: support for formula

* fix: refractor code and don't return all points

* fix: add nil params check

* fix: error handling updated

* fix: start and end params fix
2024-02-12 18:45:21 +05:30
Srikanth Chekuri
3b98073ad4
chore: add time shift function and some refactoring (#4445) 2024-02-11 00:31:47 +05:30
Srikanth Chekuri
4a4f48cec8
chore: support p9{9,5,0},75,50 for space aggregation (#4382) 2024-01-26 17:07:23 +05:30
Srikanth Chekuri
be27a92fc9
chore: add functions support (#4381) 2024-01-25 01:14:45 +05:30
Srikanth Chekuri
abaf6126e5
chore: add /v4/query_range endpoint (#4361) 2024-01-16 16:56:20 +05:30
Srikanth Chekuri
e7fabca38e
chore: fix the query range cache gaps (#4283) 2024-01-08 18:00:42 +05:30
Srikanth Chekuri
9360c61dca
chore: update BuilderQuery struct and add PrepareTimeseriesFilterQuery (#4165) 2023-12-12 07:24:33 +05:30
Nityananda Gohain
7451e885c3
feat: custom timeout and contextTimeout flag in response (#4022) 2023-11-29 09:10:30 +05:30
Raj Kamal Singh
718eb7b381
QS: logparsingpipeline previews (#3694)
* chore: rename model.GetLogsResponse -> model.SignozLog for use in both requests and responses

* feat: add test for simulating log pipelines processing

* feat: get pipeline preview tests passing

* chore: cleanup
2023-10-09 15:25:13 +05:30
Eng Zer Jun
dc4acc0730
refactor(query-service): remove redundant nil check (#3614)
From the Go specification [1]:

  "1. For a nil slice, the number of iterations is 0."
  "3. If the map is nil, the number of iterations is 0."

Therefore, an additional nil check for before the loop is unnecessary.

[1]: https://go.dev/ref/spec#For_range

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2023-09-24 14:42:17 +05:30
Srikanth Chekuri
043e5ca880
fix: skip first record only for rate metrics (#3609) 2023-09-22 15:43:21 +05:30
Raj Kamal Singh
3db8a25eb9
Add support in query service for querybuilder filterset based log pipelines (#3560)
* chore: use v3.Filterset as pipeline filters in logparsing pipelines integration tests

* chore: get logparsing integration tests passing with filterset based pipeline

* chore: get all other breaking tests passing

* chore: move models.logparsingpipeline to logparsingpipeline.model

* chore: implement Valuer and Scanner interfaces for v3.FilterSet
2023-09-20 12:39:34 +05:30
Nityananda Gohain
ed809474d6
feat: json filter bool support (#3544)
* feat: json filter bool support

* fix: update json filter for bool
2023-09-13 21:00:40 +05:30
Nityananda Gohain
17ae197bc3
feat: support for filtering json inside body (#3534)
* feat: support for json query on body

* feat: json filter parser updated for scalar values
2023-09-13 13:46:06 +05:30
Srikanth Chekuri
25fc7b83ec
chore: update saved views endpoints (#3314) 2023-08-25 09:22:46 +05:30