776 Commits

Author SHA1 Message Date
Dhawal Sanghvi
ab42700245
query-service: add cluster name cli flag (#3713)
* chore: query-service  add cluster name cli flag

* chore: add schema migrator to docker compose file

* chore: add schema migrator to docker swarm compose file

* chore: 📌 pin versions: Schema Migrator 0.79.10 and update compose files

* chore: 🔧 update compose depends_on for schema-migrator service

---------

Co-authored-by: Prashant Shahi <prashant@signoz.io>
2023-10-20 12:37:45 +05:30
Swapnil Nakade
6b2427f1c2
(chore): replace ioutil with io and os for file operations (#3761)
Switched all file operations from ioutil package to io and os packages due to the deprecation of ioutil in Go 1.16. This change contributes to the maintainability of the codebase, ensuring it's up-to-date with the current standard library. Additionally, implemented usage of filepath.Join for platform-independent file paths.
2023-10-19 08:46:20 +00:00
Srikanth Chekuri
5c5ee2cc70
fix: nil pointer dereference in query builder expression (#3764) 2023-10-18 15:07:57 +05:30
Srikanth Chekuri
e0b83bda62
feat: add created{By,At} , updated{By,At} to alerts/dashboards (#3754) 2023-10-17 23:20:54 +05:30
Vishal Sharma
f8d3fa0fdb
chore: update query service telemetry (#3735)
* chore: update query service telemetry

* chore: address review comments

* chore: add group call and update metrics condition

* chore: update company_domain
2023-10-17 11:49:50 +05:30
Raj Kamal Singh
546d98ca9c
feat: agentConf.manager as opamp conf provider (#3747)
* chore: add integration test for log pipelines being recommended to agents on connection

* chore: agentConf.Manager as AgentConfigProvider

* feat: logparsingpipelines as an AgentFeature

* chore: some cleanup

* feat: update agentConf init in ee query-service

* chore: more cleanup and move opamp/logspipeline -> logparsingpipeline/collector_config.go

* chore: some more cleanup

* chore: set agent.RemoteConfig after broadcasting conf to all agents

* chore: add test scenario for post remote conf application
2023-10-15 21:04:19 +05:30
Raj Kamal Singh
cb155a1172
feat: opamp server with agent config provider (#3737)
* feat: add interface for opamp.AgentConfigProvider

* feat: add iface and plumbing for generating recommended conf in opamp/agent

* feat: get opamp server config provider tests started

* chore: add test scenario for agent connection without a config recommendation

* chore: add test scenario for agent connection with a config recommendation

* chore: add test for validating config deployment status gets reported

* chore: add test for rolling out latest config recommendations when config changes

* chore: wrap up opamp server lifecycle tests

* chore: some tests cleanup

* chore: get all tests passing

* chore: update opamp server init logic in ee query service

* chore: some cleanup

* chore: some final cleanup
2023-10-14 09:16:14 +05:30
Srikanth Chekuri
2c96512a8a
chore: do not allow deleting more than one panel on update request (#3703) 2023-10-10 13:07:20 +00:00
Raj Kamal Singh
a84a70df14
QS: logs pipelines preview http handler (#3701)
* feat: add logsparsingpipeline controller api for pipeline previews

* feat: add http handler and route for generating pipeline previews

* feat: use a response model for pipeline previews response
2023-10-10 14:09:55 +05:30
Vishal Sharma
dcea79cef3
feat: ingestion key management (#3699) 2023-10-09 21:06:01 +05:30
Raj Kamal Singh
718eb7b381
QS: logparsingpipeline previews (#3694)
* chore: rename model.GetLogsResponse -> model.SignozLog for use in both requests and responses

* feat: add test for simulating log pipelines processing

* feat: get pipeline preview tests passing

* chore: cleanup
2023-10-09 15:25:13 +05:30
Nityananda Gohain
abed60bdfa
fix: exists check for json filters added (#3675)
* fix: exists check for json filters added

* fix: comment updated
2023-10-06 09:26:37 +05:30
Nityananda Gohain
9f751688cc
fix: limit issue fixed when using contains (#3649) 2023-09-29 18:20:40 +05:30
Palash Gupta
821471f4ab
feat(query-builder): add limit, order by and having clause to formula (#3623)
* feat: query builder formula is updated

* feat: formula is updated for having and limit

* feat: orderBy is updated

* feat: formula is added

* chore: add query-service support for formula limit and order by

* feat: enable more filters is displayed when all data source is metrics

* chore: feedback is updated

* chore: feedback is updated

---------

Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
Co-authored-by: Rajat Dabade <rajat@signoz.io>
2023-09-27 17:34:47 +05:30
Nityananda Gohain
a4a285c074
feat: add support for freehand json query (#3625)
* feat: freehand json search

* feat: support for freehand json query

* fix: minor updates

* fix: minor refactor
2023-09-26 20:10:39 +05:30
Raj Kamal Singh
3db8a25eb9
Add support in query service for querybuilder filterset based log pipelines (#3560)
* chore: use v3.Filterset as pipeline filters in logparsing pipelines integration tests

* chore: get logparsing integration tests passing with filterset based pipeline

* chore: get all other breaking tests passing

* chore: move models.logparsingpipeline to logparsingpipeline.model

* chore: implement Valuer and Scanner interfaces for v3.FilterSet
2023-09-20 12:39:34 +05:30
Srikanth Chekuri
735ab8e118
fix: add missed variable substitution for promql querires (#3584) 2023-09-19 17:49:11 +05:30
Srikanth Chekuri
416a058eab
Query range caching (#2142) 2023-09-17 10:40:45 +05:30
Palash Gupta
4227faa6b5
feat: limit & order by is enabled in the metrics query builder (#3566)
* feat: limit filter is enabled in the metrics filters

* chore: orderBy is enabled for metrics data source

* chore: fix table type limit and order by

---------

Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
2023-09-16 18:32:51 +05:30
Nityananda Gohain
ed809474d6
feat: json filter bool support (#3544)
* feat: json filter bool support

* fix: update json filter for bool
2023-09-13 21:00:40 +05:30
dhawal1248
1ffb1b4a5d fix: remove unnecessary braces in clickhouse reader 2023-09-13 15:26:27 +05:30
Nityananda Gohain
17ae197bc3
feat: support for filtering json inside body (#3534)
* feat: support for json query on body

* feat: json filter parser updated for scalar values
2023-09-13 13:46:06 +05:30
Vishal Sharma
7209ac0007
fix: login/precheck api in non-ee variant (#3516)
* fix: login/precheck api in non-ee variant

* fix: add return statement

* fix: make skip config empty

---------

Co-authored-by: Palash Gupta <palashgdev@gmail.com>
Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
2023-09-12 12:53:46 +05:30
Raj Kamal Singh
dfd94f67bd
chore: return 400 http status on pipeline validation error (#3472)
* chore: add integration test for log parsing pipelines validation

* chore: add helpers for creating unauthorized, unavailable & not found api errors

* chore: return *model.APIError from logpipeline and agentConf functions

* chore: some cleanup

* chore: some more cleanup

* chore: one more round of cleanups
2023-09-10 16:48:29 +05:30
Raj Kamal Singh
f450d71a25
fix: avoid pipeline builder panic when first op is disabled (#3500)
* fix: avoid pipeline builder panic if first op is disabled

* chore: use pipeline builder test to trigger getOperator panic

---------

Co-authored-by: Nityananda Gohain <nityanandagohain@gmail.com>
2023-09-07 17:47:09 +05:30
Srikanth Chekuri
921fca5e67
fix: do not add redundant [] for array (#3484) 2023-09-07 15:20:14 +05:30
Srikanth Chekuri
89e8fb715c
chore: bump SigNoz/prometheus (#3410) 2023-09-05 18:17:32 +05:30
Raj Kamal Singh
03acc33888
chore: log parsing pipelines happy path integration test (#3424)
* chore: get started with logparsingpipeline happy path integration test

* chore: log pipelines happy path: assert opampclient receives expected otel config processors for log pipelines.

* chore: logparsing pipeline happy path: validate deployment status update

* chore: logparsing pipeline happy path: validate posting pipelines update

* chore: some cleanup

* chore: some more cleanup

* chore: some more cleanup

* fix: address review comments

---------

Co-authored-by: Nityananda Gohain <nityanandagohain@gmail.com>
2023-09-02 20:01:03 +05:30
Nityananda Gohain
e596dd77bd
fix: live tail query formatting fix (#3453)
* fix: live tail query formatting fix

* fix: minor fixes in formatter

---------

Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
2023-08-30 20:38:46 +05:30
Nityananda Gohain
988dd1bcf0
fix: exists, nexists support for top level logs columns (#3434)
* fix: exists, nexists support for top level logs columns

* fix: dont check value for exists and nexists

* fix: exists, nexists updated for materialized columns

* fix: remove unnecesary variable

* fix: exists check updated in all places
2023-08-28 15:48:39 +05:30
Srikanth Chekuri
25fc7b83ec
chore: update saved views endpoints (#3314) 2023-08-25 09:22:46 +05:30
Srikanth Chekuri
7586b50c5a
fix: use query-service API to fetch triggered alerts (#3417) 2023-08-24 17:14:42 +05:30
Srikanth Chekuri
0bee0a6d90
fix: update dashboards to use placeholder params (#3408) 2023-08-24 12:14:16 +05:30
Nityananda Gohain
ee6b290a0c
feat: get and update log fields updated to support new materialized c… (#3275)
* feat: get and update log fields updated to support new materialized columns and index

* feat: get attribute keys logic updated

* feat: logs qb changes to support new materialized columns

* feat: don't allow updating static top level fields

* feat: old logs parser updated

* feat: upgrade clickhouse

* fix: columnname format updated for materialized columns

* feat: get fields updated

* feat: minor changes

* fix: default values for distributed columns

* feat: common function for for clickhouse formatted column name

* chore: remove interesting selected fields

* fix: update clickhouse version in other place

---------

Co-authored-by: Prashant Shahi <prashant@signoz.io>
2023-08-23 15:03:24 +05:30
Srikanth Chekuri
e04d5fa7e8
Align the query start and end timestamps to the nearest multiple of step (#2844) 2023-08-22 17:09:58 +05:30
Nityananda Gohain
2df5a9d72d
fix: ts issue fixed with live tail (#3397) 2023-08-22 16:48:44 +05:30
Vishal Sharma
f8bfd1abc4
feat: add regex support to traces (#3393) 2023-08-22 10:42:53 +05:30
Nityananda Gohain
a75f4f02d6
fix: regex support updated in logs (#3392) 2023-08-21 16:08:42 +05:30
Vishal Sharma
c8bad4fc79
feat: introduce PreferRPM feature (#3197)
* feat: introduce PreferRPM feature
Completed in logs and traces but tests of metrics are not updated

* chore: pass preferRPM feature flag rather than fn

* chore: support metrics rpm

* chore: remove step interval validation
As step interval is missing in formula queries

* chore: update failing tests

---------

Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
2023-08-18 07:32:05 +05:30
Srikanth Chekuri
8ef4c0bcdd
fix: use ts as column to make formula work (#3351) 2023-08-16 16:10:59 +05:30
Amol Umbark
2bf534b56f
feat: add ms teams channels (#2689)
* feat: api machinery to support enterprise plan channels

* feat: backend for handling ms teams

* feat: frontend for ms teams

* fix: fixed some minor issues wiht ms teams

* fix: resolved issue with feature gate

* chore: add missing span metrics

* chore: some minor changes are updated

* feat: added the oss flag is updated

---------

Co-authored-by: Vishal Sharma <makeavish786@gmail.com>
Co-authored-by: Srikanth Chekuri <srikanth.chekuri92@gmail.com>
Co-authored-by: Palash Gupta <palashgdev@gmail.com>
2023-08-15 21:19:05 +05:30
Nityananda Gohain
17c61a61ec
chore: format for livetail changed (#3332) 2023-08-14 17:08:57 +05:30
Chandan Jhunjhunwal
03220fcf11
chore: Fixed the typo in ProfilePirctureURL attr (#3307) 2023-08-12 10:10:25 +05:30
Nityananda Gohain
233589b867
feat: convert livetail to a get endpoint (#3321) 2023-08-11 21:54:44 +05:30
Srikanth Chekuri
abb8b2b122
fix: lowercase filter operator and increase default conn settings (#3310) 2023-08-10 17:20:34 +05:30
Nityananda Gohain
68ab022836
feat: limit offset logic updated for logs list view (#3243) 2023-08-02 13:06:41 +05:30
Nityananda Gohain
1a3e46cecd
feat: integrate pipelines API (#2457)
* chore: integrate pipelines API

* fix: limit support integrated in pipelines

* fix: interface to string

* fix: json parser and allow deleting all pipelines

* fix: output modified if operators are disabled

* fix: validation updated for operators

* fix: expression check added

* fix: regex expression check added

* fix: remove operator validation updated

* fix: tests updated for pipeline builder

* fix: fix error messages in http handler

* fix: dont return payload if there is an error

* fix: extracting userId from context moved to auth package

* fix: api errors moved to http handler

* fix: get version logic updated

* fix: deployment result message updated

* fix: pipeline builder edgecase fixed and tests updated

* fix: get failing postablePipeline tests to pass

---------

Co-authored-by: Vishal Sharma <makeavish786@gmail.com>
Co-authored-by: Raj <rkssisodiya@gmail.com>
2023-07-31 21:34:42 +05:30
Nityananda Gohain
203eef8cde
feat: hotfix check if limit is not zero (#3221)
* feat: hotfix check if limit is not zero

* fix: move to common function
2023-07-28 13:56:36 +05:30
Vishal Sharma
b915f9ef7b
feat: add new params labelsArray to series (#3214) 2023-07-28 10:00:16 +05:30
Nityananda Gohain
e86e045a28
fix: ignore autocomplete request for body (#3208) 2023-07-27 09:49:34 +05:30