ahrav
88967192e8
[bug] - Improve BufferedFileReader Close Behavior ( #2768 )
...
* Dont allow read after close
* update comment
* remove defer
2024-04-30 08:50:16 -07:00
ahrav
7e47b96631
[feat] - Add ReadFrom method to BufferedFileWriter ( #2759 )
...
* Update write method in contentWriter interface
* fix lint
* Add a buffered file reader
* update comments
* update comment
* add compile type checks
* fix
* fix test
* inline if
* Add ReadFrom method to the BufferedFileWriter
* update test
* fix test
* update benchmark
2024-04-30 07:41:05 -07:00
ahrav
46d4ae1334
[feat] - buffered file reader ( #2731 )
...
* Update write method in contentWriter interface
* fix lint
* Add a buffered file reader
* update comments
* update comment
* add compile type checks
* fix
* fix test
* inline if
* magic
* update comment
2024-04-30 07:31:37 -07:00
ahrav
5d3b90799e
[bug] - Fix the metric for buffered file writer writes ( #2750 )
...
* avoid double counting
* add disk write count back
2024-04-25 13:04:07 -07:00
ahrav
d89b0cdace
[bug] - fix buffer size metric ( #2749 )
...
* fix metric
* another fix
2024-04-25 11:43:38 -07:00
ahrav
b430dae83e
[refactor] - lazy buffer retrieval ( #2745 )
...
* only create the contentWriter once
* update test
* Lazily fetch buffer from the pool
* fix tests
* fix test
* remove ctx
2024-04-25 08:27:15 -07:00
ahrav
8d3404804e
[chore] - update buffered file writer metric ( #2740 )
...
* missed one
* add comment
2024-04-25 08:17:32 -07:00
ahrav
97599b19e7
update buffer metrics ( #2737 )
2024-04-24 07:22:06 -07:00
ahrav
ea4d9d2d32
[bug] - Correctly return the checked out buffer to the pool ( #2732 )
...
* Make sure to return the buffer to the pool
* update comment
* defer the return
* remove anonymous function
2024-04-23 14:38:28 -07:00
ahrav
f03aa38726
[bug] - Fix disk write metric and update BufferedFileWriter file field ( #2733 )
...
* Record the disk write after the file has been written to
* remove comment
* remove print logs
2024-04-23 14:13:13 -07:00
ahrav
4a5fbf8417
[refactor] - Update Write method signature in contentWriter interface ( #2721 )
...
* Update write method in contentWriter interface
* fix lint
2024-04-23 08:47:53 -07:00
ahrav
800cc6d90b
[chore] - Record metrics before reset ( #2556 )
...
* Record buffer metrics before resetting.
* Address comment.
2024-03-12 09:35:18 -07:00
ahrav
2e65773b27
use custom grow method ( #2555 )
2024-03-08 12:16:52 -08:00
ahrav
40bbab8add
[cleanup] - Extract buffer logic ( #2409 )
...
* extract the buffer logic into it's own package
* address comments
2024-02-15 11:40:34 -08:00
ahrav
6557b3b321
[feat] - buffered file writer metrics ( #2395 )
...
* use diff chan
* correctly use the buffered file writer
* use value from source
* reorder fields
* add tests and update
* Fix issue with buffer slices growing
* fix test
* correctly use the buffered file writer
* use value from source
* reorder fields
* fix
* add singleton
* use shared pool
* optimize
* rename and cleanup
* add metrics
* add print
* rebase
* remove extra inc
* add metrics for checkout time
* add comment
* use microseconds
* add metrics
* add metrics pkg
* add more metrics
* rever test
* remove fields
* fix
* resize and return
* update metric name
* remove comment
* address comments
* add comment
2024-02-08 07:38:40 -08:00
ahrav
843334222c
[not-fixup] - Reduce memory consumption for Buffered File Writer ( #2377 )
...
* correctly use the buffered file writer
* use value from source
* reorder fields
* use only the DetectorKey as a map field
* correctly use the buffered file writer
* use value from source
* reorder fields
* add tests and update
* Fix issue with buffer slices growing
* fix test
* fix
* add singleton
* use shared pool
* optimize
* rename and cleanup
* use correct calculation to grow buffer
* only grow if needed
* address comments
* remove unused
* remove
* rip out Grow
* address coment
* use 2k default buffer
* update comment allow large buffers to be garbage collected
2024-02-06 09:22:25 -08:00
ahrav
9867ce8eb8
Allow for configuring the buffered file writer ( #2319 )
...
* Write large diffs to tmp files
* address comments
* Move bufferedfilewriter to own pkg
* update test
* swallow write err
* use buffer pool
* use size vs len
* use interface
* fix test
* update comments
* fix test
* Allow for configuring the buffered file writer
* remove unused
* add missing method
* remove
* remove unused
* move parser and commit struct closer to where they are used
* linter change
* fix snifftest
* address comments
* add more kvp pairs to error
* fix test
* update
* add back missing metadata fields
* address comments
* remove bufferedfile writer
* fix
* address comments
* use unint8
* update interface
* adjust interface
* fix tests
* make linter happy
* fix finalize
* address comments
* update test
* address comments
* lint
* remove guard
* fix test
* fix
* add TODO
* fix tests
2024-01-30 12:51:58 -08:00
