337 commits

Author	SHA1	Message	Date
Julien Pivotto	7d0a39ac93	chore(lint): enable wg.Go ... Since our minimum supported go version is now go 1.25, we can use wg.Go. Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2026-02-17 15:21:51 +01:00
Martin Valiente Ainz	eb5a0e1eed	Refactor parse.go into an instance-based Parser interface ... Signed-off-by: Martin Valiente Ainz <64830185+tinitiuset@users.noreply.github.com>	2026-02-11 11:21:49 +01:00
Martin Valiente Ainz	af16f35ad6	PromQL: Refactor parser to use instance configuration instead of global flags ... Parser configuration is now per-engine/API/loader and no longer uses package-level flags, so behavior is consistent and tests don't rely on save/restore of global variables. Signed-off-by: Martin Valiente Ainz <64830185+tinitiuset@users.noreply.github.com>	2026-02-11 11:16:04 +01:00
Sasha	1dcdb07d30	promql: use Kahan summation for Native Histograms (#15687) ... As for float samples, Kahan summation is used for the `sum` and `avg` aggregation and for the respective `_over_time` functions. Kahan summation is not perfect. This commit also adds tests that even Kahan summation cannot reliably pass. These tests are commented out. Note that the behavior might be different on other hardware platforms. We have to keep an eye on test failing on other hardware platforms and adjust them accordingly. Signed-off-by: Aleksandr Smirnov <5targazer@mail.ru>	2026-02-08 00:52:22 +01:00
zenador	4321a5573c	Use custom annotation for histogram quantile monotonicity info to provide more details (#15578) ... Signed-off-by: Jeanette Tan <jeanette.tan@grafana.com>	2026-02-05 18:35:48 +01:00
zenador	c0ad853750	promql: Make it possible to add custom details in annotations and summarise multiple of the same annotation (#15577) ... Signed-off-by: Jeanette Tan <jeanette.tan@grafana.com> Signed-off-by: zenador <zenador@users.noreply.github.com> Co-authored-by: Björn Rabenstein <github@rabenste.in>	2026-02-03 15:12:02 +01:00
Bartlomiej Plotka	848b16d686	test: Add benchmark without storage + fix skipRecording mock feature (#17987) ... * test: Add benchmark without storage Signed-off-by: bwplotka <bwplotka@gmail.com> make bench fair Signed-off-by: bwplotka <bwplotka@gmail.com> tmp Signed-off-by: bwplotka <bwplotka@gmail.com> * Apply suggestions from code review Co-authored-by: Arve Knudsen <arve.knudsen@gmail.com> Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com> --------- Signed-off-by: bwplotka <bwplotka@gmail.com> Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com> Co-authored-by: Arve Knudsen <arve.knudsen@gmail.com>	2026-02-02 12:44:11 +00:00
Bartlomiej Plotka	9657c23c37	storage: optimized fanoutAppenderV2 (#17976) ... * storage: add BenchmarkFanoutAppenderV2 Signed-off-by: bwplotka <bwplotka@gmail.com> * fix: optimized fanoutAppenderV2 Signed-off-by: bwplotka <bwplotka@gmail.com> * optimized more Signed-off-by: bwplotka <bwplotka@gmail.com> --------- Signed-off-by: bwplotka <bwplotka@gmail.com>	2026-02-02 07:04:30 +00:00
Bartlomiej Plotka	aa0f00efdf	tests(teststorage, api_test): Fix leaking readers; kill fake exemplar storage (#17906) ... * tests(teststorage): Fix leaking readers; use TSDB exemplar storage instead of fake Signed-off-by: bwplotka <bwplotka@gmail.com> * switched to v1 exemplar flow for now Signed-off-by: bwplotka <bwplotka@gmail.com> --------- Signed-off-by: bwplotka <bwplotka@gmail.com>	2026-01-27 10:07:56 +00:00
Bartlomiej Plotka	0d116b0994	tests(teststorage): Close Storage in the helper (#17902) ... Signed-off-by: bwplotka <bwplotka@gmail.com>	2026-01-23 08:41:35 +00:00
George Krajcsovits	21fb899c32	fix(teststorage/appender.go): TODO and Sample staleness check (#17905) ... * fix(teststorage/appender.go): TODO and Sample staleness check Allow different order of consecutive stale samples between the expected and actual array for RequireEqual and RequireNotEqual by trying to swap the expected side until it matches. Also fix the definition of stale sample in the test, it's not only float, but defined for native histograms as well. Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com> * add unit tests Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com> --------- Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com>	2026-01-21 15:25:31 +00:00
Bartlomiej Plotka	04a3ef75f2	chore: remove testutil.T which is no longer needed since Go 1.13 (#17903) ... testutil.T was needed before https://go.dev/doc/go1.13#testingpkgtesting Now it's inconsistent and confusing, so let's kill it. Signed-off-by: bwplotka <bwplotka@gmail.com>	2026-01-21 13:02:58 +00:00
Bartlomiej Plotka	664b255699	Merge pull request #17867 from prometheus/bwplotka/a2-scrape-1 ... refactor(appenderV2)[PART5a]: add AppendableV2 support to scrape loop + tests	2026-01-21 08:21:56 +00:00
Bryan Boreham	853572c1bf	Merge pull request #17830 from hritz220/util/strutil-enhance-test-coverage ... util: enhance test coverage for strutil package	2026-01-20 11:43:41 +00:00
Julius Volz	1d3d98ed16	Merge pull request #17644 from prometheus/binop-fill-modifier ... PromQL: Add `fill*()` binop modifiers to provide default values for missing series	2026-01-19 20:05:52 +01:00
Bartlomiej Plotka	c4b0da94db	Merge pull request #17835 from prometheus/bwplotka/a2-storage-support ... feat(storage)[PART4b]: add AppenderV2 to the rest of storage.Storage implementations + mock exemplar fix	2026-01-16 13:04:14 +00:00
Julien Pivotto	66bb47ade6	fuzzing: fix artifact path and experimental parser flags ... Fix two issues in fuzzing infrastructure: - Correct artifact upload path from promql/testdata/fuzz to util/fuzzing/testdata/fuzz to match where Go stores crash artifacts - Fix GetCorpusForFuzzParseExpr to preserve original parser flag values instead of always resetting them to false, which was disabling experimental features before actual fuzzing ran Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2026-01-16 12:07:16 +01:00
bwplotka	f61a83bcd6	fix: appenderV2 mock exemplar appendErr injection before appending it ... Signed-off-by: bwplotka <bwplotka@gmail.com>	2026-01-16 10:47:00 +00:00
bwplotka	1d3c6210f3	add extra fanout test ... Signed-off-by: bwplotka <bwplotka@gmail.com>	2026-01-15 14:13:58 +00:00
Julius Volz	d3b6e61487	Put binop fill modifiers behind a feature flag ... Signed-off-by: Julius Volz <julius.volz@gmail.com>	2026-01-15 11:18:48 +01:00
Bartlomiej Plotka	3374d2e56f	feat(teststorage)[PART4a]: Add AppendableV2 support for mock Appendable (#17834) ... * feat(teststorage)[PART4a]: Add AppendableV2 support for mock Appendable Signed-off-by: bwplotka <bwplotka@gmail.com> * fix: adjusted AppenderV1 flow for reliability Found in https://github.com/prometheus/prometheus/pull/17838 and by Krajo comment Signed-off-by: bwplotka <bwplotka@gmail.com> * addressed comments Signed-off-by: bwplotka <bwplotka@gmail.com> * fix broken appV2 commit and rollback; added tests Signed-off-by: bwplotka <bwplotka@gmail.com> --------- Signed-off-by: bwplotka <bwplotka@gmail.com>	2026-01-14 13:48:33 +00:00
Julien Pivotto	de0a864b5c	Fuzzing: Move to go fuzzing ... Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2026-01-12 12:59:10 +01:00
Ritik Shukla	f9242d4707	util: enhance test coverage for strutil package ... - Added comprehensive edge case tests for SanitizeLabelName (10 cases) - Added comprehensive edge case tests for SanitizeFullLabelName (15 cases) - Added more test cases for link generation functions (4 additional cases) - Fixed unicode test case: corrected expected underscores from 7 to 5 - Fixed digits test case: corrected expected output from '_____' to '_2345' - Converted tests to table-driven format with named subtests - Achieved 100% code coverage for the package Signed-off-by: Ritik Shukla <ritikshukla@Ritiks-MacBook-Air.local>	2026-01-10 16:05:21 +05:30
Julius Hinze	22463b1e9f	tsdb: add support for OOO exemplars in CircularExemplarStorage (#17469) ... * tsdb: add support for OOO exemplars in CircularExemplarStorage Doubly linked exemplar storage resize. Split exemplar buffer resize into shrink and grow functions. Skip duplicate OOO exemplars, re-initialize emptied index after deleting its last exemplar. Signed-off-by: Julius Hinze <julius.hinze@grafana.com>	2026-01-07 13:25:50 +01:00
Ben Kochie	e14795bbf4	Remove copyright date from headers (#17785) ... Remove copyright dates from various files as part of [PROM-50]. [PROM-50]: https://github.com/prometheus/proposals/blob/main/proposals/0050-remove-copyright-dates.md Signed-off-by: SuperQ <superq@gmail.com>	2026-01-05 13:46:21 +01:00
Bartlomiej Plotka	17e06dbab5	refactor(scrape)[PART2]: simplified scrapeLoop constructors & tests; add teststorage.Appendable mock (#17631) ... * refactor(scrape): simplified scrapeLoop constructors & tests; add teststorage.Appender mock Signed-off-by: bwplotka <bwplotka@gmail.com> debug * refactor(scrape): simplified newLoop even more Signed-off-by: bwplotka <bwplotka@gmail.com> * refactor(scrape): rename sl -> app, slApp -> app Signed-off-by: bwplotka <bwplotka@gmail.com> * fix TestScrapeLoopRun flakiness Signed-off-by: bwplotka <bwplotka@gmail.com> * fix lint Signed-off-by: bwplotka <bwplotka@gmail.com> * kill unused listSeriesSet code Signed-off-by: bwplotka <bwplotka@gmail.com> * fix closing to not panic Signed-off-by: bwplotka <bwplotka@gmail.com> * added extra benchmark for scrapeAndReport Signed-off-by: bwplotka <bwplotka@gmail.com> * added extra benchmark for restartLoops Signed-off-by: bwplotka <bwplotka@gmail.com> * addressed last comments Signed-off-by: bwplotka <bwplotka@gmail.com> * fix TestConcurrentAppender_ReturnsErrAppender naming Signed-off-by: bwplotka <bwplotka@gmail.com> * addressed small comments Signed-off-by: bwplotka <bwplotka@gmail.com> * refactor(scrape): ensure scrape config is reloaded; added test Signed-off-by: bwplotka <bwplotka@gmail.com> * addressed comments. Signed-off-by: bwplotka <bwplotka@gmail.com> --------- Signed-off-by: bwplotka <bwplotka@gmail.com>	2025-12-22 09:38:48 +00:00
Joshua Rogers	a155ad55a3	httputil: add Vary: Accept-Encoding and fix compression headers (#17466) ... - Emit `Vary: Accept-Encoding` in newCompressedResponseWriter so shared caches key responses by content-coding. This prevents cache poisoning and undecodable bytes when a compressed variant is cached and later served to a client that didn't advertise support. (RFC 9110 §12.5.5 "Vary"; RFC 9111 §4.1 cache key & Vary) - When selecting gzip/deflate, set `Content-Encoding` and delete any existing `Content-Length` so Go's net/http can frame the message correctly (chunked for HTTP/1.1; implicit for HTTP/2+). This avoids stale length mismatches and related proxy/client issues. Signed-off-by: Joshua Rogers <MegaManSec@users.noreply.github.com>	2025-12-21 10:15:35 +01:00
Julien Pivotto	a5671a002f	API: Add a /api/v1/features endpoint ... Signed-off-by: Julien Pivotto <291750+roidelapluie@users.noreply.github.com>	2025-12-09 16:13:14 +01:00
Clark McCauley	9d508a4888	util: add +Inf bucket in MetricFamiliesToWriteRequest when not present (#15864) ... * Add +Inf bucket in MetricFamiliesToWriteRequest if not present Signed-off-by: Clark McCauley <clarkmccauley@gmail.com>	2025-11-11 12:43:04 +01:00
Ben Kochie	204249fcb5	Update golangci-lint (#17478) ... * Update golangci-lint to v2.6.0 * Fixup various linting issues. * Fixup deprecations. * Add exception for `labels.MetricName` deprecation. Signed-off-by: SuperQ <superq@gmail.com>	2025-11-05 13:47:34 +01:00
Ben Kochie	48956f60d7	Update modernize (#17471) ... Apply additional Go modernize tool improvements. Signed-off-by: SuperQ <superq@gmail.com>	2025-11-04 05:13:49 +00:00
Linas Medžiūnas	44df626620	promql (histograms): reconcile mismatched NHCB bounds (#17278) ... Fixes #17255. The implementation happens mostly in the Add and Sub method, but the reconciliation works for all relevant operations. For example, you can now `rate` over a range wherein the custom bucket boundaries are changing. Any custom bucket reconciliation is flagged with an info-level annotation. --------- Signed-off-by: Linas Medziunas <linas.medziunas@gmail.com> Signed-off-by: Linas Medžiūnas <linasm@users.noreply.github.com>	2025-10-18 01:03:52 +02:00
beorn7	ad7d1aed99	Phase out native histogram feature flag ... The detailed plan for this is laid out in https://github.com/prometheus/prometheus/issues/16572 . This commit adds a global and local scrape config option `scrape_native_histograms`, which has to be set to true to ingest native histograms. To ease the transition, the feature flag is changed to simply set the default of `scrape_native_histograms` to true. Further implications: - The default scrape protocols now depend on the `scrape_native_histograms` setting. - Everywhere else, histograms are now "on by default". Documentation beyond the one for the feature flag and the scrape config are deliberately left out. See https://github.com/prometheus/prometheus/pull/17232 for that. Signed-off-by: beorn7 <beorn@grafana.com>	2025-10-15 14:50:52 +02:00
György Krajcsovits	c26a5390aa	perf(tsdb): reuse map of sample types to speed up head appender ... While investigating +10% CPU in v3.7 release, found that ~5% is from expanding the types map. Try reuse. Also fix a linter error. Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com>	2025-10-06 21:44:34 +02:00
Bryan Boreham	0d3ec05056	Merge pull request #17043 from machine424/ffl ... chore: allow seamless use of testing/synctest for >=go1.24	2025-09-30 12:11:12 +01:00
Jan Fajerski	c9e0e36701	Add comments clarifying why promql.Querylogger exists (#17231) ... And why we only have one implementation in this code base. Fixes: https://github.com/prometheus/prometheus/issues/15869 Signed-off-by: Jan Fajerski <jfajersk@redhat.com>	2025-09-26 15:33:09 +01:00
machine424	365409d3be	chore: allow seamless use of testing/synctest for >=go1.24 ... Signed-off-by: machine424 <ayoubmrini424@gmail.com>	2025-09-19 22:48:25 +02:00
Björn Rabenstein	5b153f80a5	Merge pull request #17094 from prometheus/beorn7/histogram ... promql: Fix when to emit a HistogramCounterResetCollisionWarning	2025-09-04 13:55:41 +02:00
beorn7	2628320292	promql: Fix when to emit a HistogramCounterResetCollisionWarning ... So far, we emitted a `HistogramCounterResetCollisionWarning` when encountering conflicting counter resets in the calculation of (i)rate and friends. We even tested for that. However, in the rate calculation, we are not interested in those collisions. They are actually expected. On the other hand, we did not warn about those collisions when doing a `sum` aggregation, where such a warning would be appropriate. This commit removes the warning in the former case and adds it in the latter. Sadly, we cannot really test this as we still remove the counter reset hint for the first sample in a chunk. (And that's the only sample where we could get a `NotCounterReset` hint.) Signed-off-by: beorn7 <beorn@grafana.com>	2025-09-03 18:00:03 +02:00
Owen Williams	6ee965c255	common: Update to prom/common v0.66.0, fix TextParser creation (#17139) ... TextParser as of prom/common v0.66.0 requires an explicit validation scheme. Signed-off-by: Owen Williams <owen.williams@grafana.com>	2025-09-03 11:20:04 -04:00
beorn7	747c5ee2b1	Apply analyzer "modernize" to the whole codebase ... See https://pkg.go.dev/golang.org/x/tools/gopls/internal/analysis/modernize for details. This ran into a few issues (arguably bugs in the modernize tool), which I will fix in the next commit, so that we have transparency what was done automatically. Beyond those hiccups, I believe all the changes applied are legitimate. Even where there might be no tangible direct gain, I would argue it's still better to use the "modern" way to avoid micro discussions in tiny style PRs later. Signed-off-by: beorn7 <beorn@grafana.com>	2025-08-27 14:48:41 +02:00
Julius Hinze	cdf7208478	annotations: histogram counter reset warning includes operation ... Signed-off-by: Julius Hinze <julius.hinze@grafana.com>	2025-08-20 15:14:21 +02:00
Julius Hinze	77b5c3f217	Histograms: set annotation when adding or subtracting histograms that have not_reset and reset hints. ... Signed-off-by: Julius Hinze <julius.hinze@grafana.com>	2025-08-20 15:00:45 +02:00
Arve Knudsen	0a40df33fb	Make metric/label name validation scheme explicit (#16928) ... * Parameterize metric/label name validation scheme Parameterized metric/label name validation scheme --------- Signed-off-by: Arve Knudsen <arve.knudsen@gmail.com> Co-authored-by: Julius Hinze <julius.hinze@grafana.com>	2025-08-18 08:09:00 +00:00
Neeraj Gartia	2c0de4e7c2	Fix histogram_quantile annotation in range query when delayed name removal is disabled (#16794) ... Signed-off-by: Neeraj Gartia <neerajgartia211002@gmail.com>	2025-08-13 18:06:48 +02:00
Matthieu MOREL	cef219c31c	chore: enable unused-receiver rule from revive ... Signed-off-by: Matthieu MOREL <matthieu.morel35@gmail.com>	2025-08-04 09:43:33 +00:00
Carrie Edwards	44b0fbba1e	No info annotation for rate/increase when type is histogram (#16915) ... Signed-off-by: Carrie Edwards <edwrdscarrie@gmail.com>	2025-07-24 10:11:37 -07:00
George Krajcsovits	5b7ff92d95	fix(promql): histogram_quantile and histogram_fraction NaN observed in native histogram (#16724) ... * fix(promql): histogram_quantile NaN observed in native histogram Fixes: #16578 See the issue for detailed explanation. When a histogram had only NaN observations and no normal observations, we returned 0 from the quantile, which is completely wrong. If there were normal observations but we went over them, we returned the upper bound of the existing buckets, however that contradicts expectations on histogram_fraction. Now we return NaN if the quantile is calculated to be over all normal observations, falling into NaNs (in a virtual +Inf bucket). We also return info level annotations if we see any NaN observations. The annotation calls out if we returned NaN or even if we took the virtual +Inf bucket into account. Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com> * fix(promql): histogram_fraction NaN observed in native histogram Fixes: #16580 According to the specification we should not take NaN observations into account when calculating the fraction. This commit fixes that and adds an info level annotation to let the user know about this. Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com>	2025-06-25 13:37:43 +02:00
Björn Rabenstein	ea75bc18e9	Merge pull request #16697 from Konstantinov-Innokentii/export-query-samples-fields ... stats: Export QuerySamples StartTimestamp and Interval fields	2025-06-10 15:05:22 +02:00
Arthur Silva Sens	8d0a747237	PROM-39: Provide PromQL info annotations when rate()/increase() over series without __type__="counter" label (#16632) ... * Provide PromQL info annotations when rate()/increase() over series without counter label Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com> * Address comments Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com> --------- Signed-off-by: Arthur Silva Sens <arthursens2005@gmail.com>	2025-06-06 10:01:20 -03:00