mirror of
https://github.com/bugsink/bugsink.git
synced 2026-02-07 06:19:17 -06:00
Document some findings (Friday's work)
This commit is contained in:
@@ -1,5 +1,14 @@
|
||||
## Some thoughts on performance
|
||||
|
||||
### Thoughts after implementing eviction
|
||||
|
||||
(See also contents of ./performance/stress-with-eviction/)
|
||||
|
||||
* Surprise 1: 50 events/s (60% more than what I found below)
|
||||
* Surprise 2: in this config, I _am_ getting snappea backlog.
|
||||
|
||||
### Original thoughts
|
||||
|
||||
Now that we have playground.bugsink.com, I could get some real data on that system too.
|
||||
|
||||
I suppose the most "interesting" finding is that the ~30/s events I can handle seem to be entirely limited by the
|
||||
|
||||
21
performance/stress-with-eviction/README.md
Normal file
21
performance/stress-with-eviction/README.md
Normal file
@@ -0,0 +1,21 @@
|
||||
Some results of a small stress test (event-size: 50KiB) d.d. 27 Jun 2024
|
||||
|
||||
15 projects with `10_000` events maximum each.
|
||||
|
||||
Most interesting pictures: `df` and `snappea_queue_size`
|
||||
|
||||
What we can see: there is a backlog this time.
|
||||
|
||||
C. 8:00 UTC: Start of stress test
|
||||
C. 9:00 UTC: Per project max event is being hit; disk usage increase slows down.
|
||||
C. 15:00 UTC: I turned off the stress test; from that point the backlog (and hence the disk usage of undigested events) was reduced.
|
||||
C. 16:00 UTC: Backlog reduced to 0
|
||||
|
||||
Post-test (next day) db size is 5518716928 (5.2GiB)
|
||||
|
||||
Open question: what is causing the increase of disk usage between 9:00 and 16:00 (i.e. between max-hit and test-done). Some options:
|
||||
|
||||
* Logs
|
||||
* DB inefficiencies (no vacuum yet)
|
||||
* Issues / other items in the DB.
|
||||
Issues seems unlikely TBH: there is some increase in the number of issues (we have random event types, with a long-tail distribution, so new issues may always arise, but after the test there are only 6611 total issues)
|
||||
BIN
performance/stress-with-eviction/df-day.png
Normal file
BIN
performance/stress-with-eviction/df-day.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 21 KiB |
BIN
performance/stress-with-eviction/event_ingest_count-day.png
Normal file
BIN
performance/stress-with-eviction/event_ingest_count-day.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 24 KiB |
BIN
performance/stress-with-eviction/response_time_api_avg-day.png
Normal file
BIN
performance/stress-with-eviction/response_time_api_avg-day.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 17 KiB |
BIN
performance/stress-with-eviction/response_time_api_max-day.png
Normal file
BIN
performance/stress-with-eviction/response_time_api_max-day.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 19 KiB |
BIN
performance/stress-with-eviction/snappea_queue_size-day.png
Normal file
BIN
performance/stress-with-eviction/snappea_queue_size-day.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 19 KiB |
BIN
performance/stress-with-eviction/total_requests-day.png
Normal file
BIN
performance/stress-with-eviction/total_requests-day.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 18 KiB |
Reference in New Issue
Block a user