27d882cc0a
Revert "logreader.py: concurrent file existence checks" ( #34942 )
...
Revert "logreader.py: concurrent file existence checks (#34875 )"
This reverts commit e11b239b2e
7 months ago
e652f435f9
max_lat_accel.py: use parallel processing ( #34936 )
...
* use run_across_segments
* disable tqdm
7 months ago
e11b239b2e
logreader.py: concurrent file existence checks ( #34875 )
...
* concurrent file existence checks
* upper bound on parallel queries
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com>
7 months ago
65d667e60e
Revert "logreader: avoid repeated prompts in auto_strategy when rlogs are missing" ( #34919 )
...
Revert "logreader: avoid repeated prompts in auto_strategy when rlogs are mis…"
This reverts commit b8229ebca6
7 months ago
b8229ebca6
logreader: avoid repeated prompts in auto_strategy when rlogs are missing ( #34890 )
...
* avoid repeated prompts in auto_strategy when rlogs are missing
* shorter
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com>
7 months ago
5cffaf5bb5
url_file.py: remove the unnecessary str() wrapping around the hexdigest() ( #34891 )
...
remove the unnecessary str() wrapping around the hexdigest()
8 months ago
071f8ba658
LogReader: add time_series helper
8 months ago
a30d3f7d72
test_onroad: cleanup with time series LogReader ( #34613 )
9 months ago
bab1254a02
LogReader: add time series helper ( #34608 )
...
* simple time series
* example
9 months ago
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
9 months ago
5dd1972f96
logreader: support filesystem DATA_ENDPOINT ( #34340 )
...
* Check if DATA_ENDPOINT is a dir
* Change url resolution to support joining dirs
10 months ago
da2c70e097
Revert "LogReader: fix issue when your dns resolves all requests" ( #34229 )
...
Revert "LogReader: fix issue when your dns resolves all requests (#34089 )"
This reverts commit 7fc5040ed9
11 months ago
e9246df02e
ci: faster unit tests ( #34161 )
...
* fast
* lint
* try
* clean
* this
* try even more
* more
* maybe
* what
* maybe?
* maybe
* try this
* fix
* fast?
* now cache?
* debug
* again...
* maybe
* NOW!
* revert, this is already enough (for now?)
11 months ago
e19ecbf75c
CommaApi: use context manager for response handling ( #34118 )
...
use context manager for response handling
11 months ago
7fc5040ed9
LogReader: fix issue when your dns resolves all requests ( #34089 )
...
* terrible :(
* keep this spacing
11 months ago
847a5ce1f3
ci: faster model_replay ( #34036 )
...
* cache draft
* fix
* fix
* fix
* better
* zst
* more
* try
* pool
* fix
* fix
* revert :C
* better
* cleanup
* no cache
* this too
12 months ago
c995d5b9ae
ci: faster test_models ( #33941 )
...
* test
* try 4 runners
* try
* 100 for fun
* the fun is over
* try even less
12 months ago
2af9f68147
LogReader: more specific exceptions ( #33914 )
...
* more specific logreader exceptions
* huh
* fix
1 year ago
f11e5492f8
ci: keep old comment on model replay report ( #33759 )
...
keep old
1 year ago
596d8b13bb
ci: model_replay improvements ( #33753 )
...
* diff
* tr
* cleanup
* at the end
* fix
1 year ago
2e83e37984
jenkins: model replay report in PR ( #33723 )
...
* first
* first
* first
* token
* edit previous comment
* clean
* plots
* linter
* cleaner
* comment
* save ref
* fix
* remove refs
* add tokens
* fix branch
* table
* fix
* real data
* title
* github
* fix
* github api
* better
* clean
* errors
* create bucket
* true
* fix
1 year ago
606943010e
Reapply "joystickd is a real process ( #33490 )" ( #33514 )
...
* Reapply "joystickd is a real process (#33490 )"
This reverts commit c8465e3a21
1 year ago
1e92af9b3c
[bot] Update Python packages ( #33436 )
...
* Update Python packages
* bump
* specify any list of sources
ooh this is pretty nice
* update
* y
* fix
* fix that
* bump
---------
Co-authored-by: Vehicle Researcher <user@comma.ai>
Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 239cc69a20
1 year ago
9da055853f
LogReader clean ups ( #33446 )
...
* buggin me
* no caps
* remove at least one level of indirection
* no recursion, remove a bunch of junk
* default is now allfault ??
* back
* fix tests
old-commit-hash: 5796bf12b6
1 year ago
730924e7f2
LogReader: formatting and remove unnecessary type alias
...
old-commit-hash: 34305bec09
1 year ago
786aff27da
azure_container: pass the filename explicitely when using get_url ( #33407 )
...
* Pass filename explicitely when using azure container
* Do not update segments in test_processes
* openpilotci_source_zst
* Fix static analysisc
old-commit-hash: b5958ebb60
1 year ago
4f019b5f60
move selfdrive/car to opendbc ( #32630 )
...
* move most of /car
* move some car tests
move some car tests
* fix selfdrive/car/tests
* fix selfdrive/controls tests
* fix the rest of the selfdrive tests
* bump opendbc
* fix all tests
* few more non-test references
* remove opcar and move docs to car
fix these debugging scripts
fix docs
* bump opendbc and panda
forgot panda
old-commit-hash: e735a7f379
1 year ago
c551f1d239
fix bash + python3 shebangs ( #33287 )
...
fix shebangs
old-commit-hash: 1dcd660815
1 year ago
937ed5f700
Add testing closet to LogReader source ( #33242 )
...
* add testing closet to logreader source
* check source availability
* use internal_source_available
old-commit-hash: 118932acd3
1 year ago
6a2b4dedfc
tools/logreader: add desc arg to run_across_segments() ( #33226 )
...
old-commit-hash: 9e648e428d
1 year ago
7ce33fbe2b
process replay: use zst ( #33138 )
...
* test
* update refs to zst
* update
old-commit-hash: dfd387520e
1 year ago
7b67994a05
use zstandard library ( #33110 )
...
* use zstandard
* run 10
* bye bye
* this was a little overzealous
* clean up
old-commit-hash: 1b3b5ab758
1 year ago
539c828861
tools: keep re pattern file small ( #33084 )
...
remove bz2 from re file
old-commit-hash: e68bb26e14
1 year ago
309ccf6482
LogReader: support multiple log extensions in route ( #33066 )
...
* support rlog.zst
* TODO
old-commit-hash: e38a1428aa
1 year ago
4efe8d8118
Fix msgq context overrides ( #33014 )
...
* Fix msgq context overrides
* Remove unneccesary changes
* add reset_context helper
* Remove redundant import
old-commit-hash: c96dbd5a0b
1 year ago
5333e8ba20
LogReader: show total segment count in missing rlog prompt
...
old-commit-hash: 3e41b1b287
1 year ago
8adfc992e3
fix pytest tests ( #32867 )
...
* fix tests
* no dot
old-commit-hash: 6f10b8a209
1 year ago
5887093eed
LogReader: print number of missing rlogs ( #32830 )
...
* count rlogs
* minimization changes
* cache to avoid duplicate checks
* no real point in checking qlogs to just show the warning
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 504dd4543d
1 year ago
9f50db15c0
LogReader: try zst on internal source ( #32751 )
...
* internal source list files like azure api
* messy but works
* no limit
* simpler
* clean up
* clean up
* clean up
* that's obvious
* better
* we need to unfortunately return a url, so best to take a naive approach for now
* todo
* fix
* clean up
old-commit-hash: b45caf4033
1 year ago
644156420b
LogReader: revert broken check
...
it returns files OR None
old-commit-hash: 68e22faa29
1 year ago
8f402f29a3
SegmentRange: remove timestamp ( #32750 )
...
* add deprecation warning
* remove timestamp
* Update logreader.py
old-commit-hash: d5ce4b3085
1 year ago
cd8d440c86
LogReader: support reading zst logs from Azure ( #32745 )
...
* staging api
* other stuff
* ugh this should really not be duplicated, we already check the max segnum in Route class
* better error message!!
* more better
* clean up
* clean up
* breaks again
old-commit-hash: a0bbc005b6
1 year ago
ed80e9357a
LogReader: improve error messages ( #32747 )
...
* better error messages
* clean up
old-commit-hash: 3ede1e2a7c
1 year ago
e88cbb0162
add zstd Python library ( #32731 )
...
* add zstd
* fix
* uploader
* logreader: zst support
* caps
* only logreader
old-commit-hash: 04a93dd849
1 year ago
450d012166
logreader.py: optimize event loading and sorting in _LogFileReader ( #32729 )
...
* improve logfilereader
* less changes
old-commit-hash: c64bca97ba
1 year ago
008008b03a
Update to Python 3.12 ( #32548 )
...
* 3.12
* pprofile is broken
* use modified metadrivepy3-12
* 0.3.0 metadrive
* add metadrive/commaai git dependency
* metadrive git set
* pin sounddevice 0.4.6
* datetime.utcnow() deprecation
* poetry lock
* make datetime not aware
* poetry lock
* pin pytools
* google_crc32c wheel
* unpin sounddevice
* clean metadrive
* use python crc
* mypy
* 3.12.4
* allow python3.11
* test
* no pip
* poetry
* better
* better
* merge
* remove
* try
* test
* try this
* snok
* python
* simpler
* setuptools
* lower
* try
* try
* work?
* ubuntu deps
* ubuntu
* try
* remove
* move
* remove this
* names
* Update .github/workflows/tools_tests.yaml
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* python<4
* <3.13
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 148eaf8fa6
1 year ago
86b6103657
test_*.py files are no longer executable ( #32610 )
...
* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
old-commit-hash: c59887c810
1 year ago
3358745103
ruff: enable UP
...
old-commit-hash: b2e4c64cf8
1 year ago
639a634f7c
Unittest to pytest ( #32366 )
...
* add pytest-asyncio
* switch common
* switch selfdrive
* switch system
* switch tools
* small fixes
* fix setUp and valgrind pytest
* switch to setup
* fix random
* switch mock
* switch test_lateral_limits
* revert test_ui
* fix poetry.lock
* add unittest to banned-api
* add inline ignores to remaining unittest imports
* revert test_models
* revert check_can_parser_performance
* one more skip
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dd9d5d4528
1 year ago
a17639bddb
logreader: skip internal source if connection refused ( #32418 )
...
* logreader: skip internal source if connection refused
* fix indentation
* fix spacing
* explicit ipv4 and tcp
old-commit-hash: 2a46d71fc8
1 year ago
Shane Smiskol
Dean Lee
Adeeb Shihadeh
Kacper Rączy
Maxime Desroches
Justin Newberry
commaci-public
Jimmy
Hoang Bui
StefanLekanic-SYRMIA
Mauricio Alvarez Leon
cl0cks4fe
Greg Hogan