Dean Lee
a0a9df2d55
loggerd: enhance ZstdFileWriter test coverage with variable data sizes ( #34812 )
...
enhance ZstdFileWriter test coverage
2 months ago
Dean Lee
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
3 months ago
Maxime Desroches
7d5031a6d6
ci: reduce sleep in test_uploader ( #34009 )
...
less
5 months ago
Maxime Desroches
ce7317407f
ci: faster test_encoder ( #33968 )
...
* try
* timeout
* fix
6 months ago
Maxime Desroches
e0acd86ca1
ci: faster unit_tests ( #33962 )
...
faster
6 months ago
Adeeb Shihadeh
853febe21d
visionipc: remove RGB support ( #33739 )
...
* visionipc: remove RGB support
* bump
* msgq master
* fix sim
7 months ago
Hoang Bui
cb306fd7a8
CI: fix recent test_rotation skip ( #33167 )
...
old-commit-hash: 5b4b7a08fc
9 months ago
Adeeb Shihadeh
d59f9262c8
disable test_rotation until it's fixed
...
old-commit-hash: bfa8e0b2ec
9 months ago
Shane Smiskol
b0a8b3bc9d
uploader: compress with zstd ( #32736 )
...
* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed
.
* just let it auto resolve
* fix athenad/uploader tests
* zst here too
* TODOs
* yes
* Revert "TODOs"
This reverts commit 8c7da1dbd0
.
* Revert "zst here too"
This reverts commit 23b0023ddf
.
* Revert "just let it auto resolve"
This reverts commit f296d62424
.
* Revert "regen and process replay"
This reverts commit 0768330e96
.
* revert readme
* not in save_log either
* lfg
* Revert "lfg"
This reverts commit 3718559c6c
.
old-commit-hash: 7dec7c39be
9 months ago
Adeeb Shihadeh
ad42b61427
test_encoder: adjust file size tolerance
...
old-commit-hash: b51472048c
11 months ago
Harald Schäfer
f870a968e9
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
old-commit-hash: e71ec4e8d7
11 months ago
Adeeb Shihadeh
86b6103657
test_*.py files are no longer executable ( #32610 )
...
* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
old-commit-hash: c59887c810
11 months ago
Adeeb Shihadeh
cc4f53e6c6
manager: move to system/ ( #32538 )
...
* manager: move to system/
* one more
old-commit-hash: accdade4cf
11 months ago
Adeeb Shihadeh
3358745103
ruff: enable UP
...
old-commit-hash: b2e4c64cf8
11 months ago
cl0cks4fe
639a634f7c
Unittest to pytest ( #32366 )
...
* add pytest-asyncio
* switch common
* switch selfdrive
* switch system
* switch tools
* small fixes
* fix setUp and valgrind pytest
* switch to setup
* fix random
* switch mock
* switch test_lateral_limits
* revert test_ui
* fix poetry.lock
* add unittest to banned-api
* add inline ignores to remaining unittest imports
* revert test_models
* revert check_can_parser_performance
* one more skip
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dd9d5d4528
11 months ago
Adeeb Shihadeh
da31ce154a
refactor camera transformations ( #31818 )
...
* refactor camera transormations
* update users
* more stuff
* more fix
* swap
* tici
* lil shorter
old-commit-hash: e3589e4b5c
1 year ago
Adeeb Shihadeh
9735cf2eb6
timeless routes ( #31119 )
...
* timeless route
* update sort
* update test
* fix param name
old-commit-hash: 7cfc571f56
1 year ago
Cameron Clough
a09300385b
mypy: use implicit-optional ( #31590 )
...
* mypy: set implicit-optional = true
* find and replace '| None = None' -> '= None' in function args
old-commit-hash: 80da3aee14
1 year ago
Cameron Clough
9bd90112d0
use pyupgrade to update to new typing syntax ( #31580 )
...
* add pyupgrade hook
* run pyupgrade (pre-commit run -a)
* ruff --fix
* Revert "add pyupgrade hook"
This reverts commit 56ec18bb6b
.
* revert changes to third_party/
* manual type fixes
* explicit Optional wrapping capnp objects
old-commit-hash: 995250ae49
1 year ago
Adeeb Shihadeh
df6154b591
log git commit date ( #31490 )
...
* log git commit date
* unix ts
* fix
* bump cereal
* cleanup
old-commit-hash: 0723c2bc5f
1 year ago
Adeeb Shihadeh
048629564e
bootlog: remove timestamp from filename ( #31187 )
...
* bootlog: remove timestamp from filename
* revert route
* test
* revert that
* fix loggerd test
old-commit-hash: 2504341070
1 year ago
Adeeb Shihadeh
5441587c6b
mark as flaky for now
...
old-commit-hash: 6fbd844216
1 year ago
Justin Newberry
1e197545c6
Revert "test_loggerd: make rotation test more robust" ( #31168 )
...
old-commit-hash: 979dba33cd
1 year ago
Justin Newberry
1dae90e219
test_loggerd: make rotation test more robust ( #31160 )
...
* no randomness
* lots
* Revert "lots"
This reverts commit 2052fd6f7b
.
old-commit-hash: 35374f4d57
1 year ago
Adeeb Shihadeh
dc6a23a1bc
loggerd: speedup unit tests ( #31115 )
...
* first speed it up
* pytestify
* no sleep
old-commit-hash: 694fc378dd
1 year ago
Adeeb Shihadeh
6c21bbacae
update param in loggerd unit test
...
old-commit-hash: 5f1e7649e3
1 year ago
Adeeb Shihadeh
d6a8213c80
uploader cleanup ( #31035 )
...
* Reapply "uploader cleanup" (#31033 )
This reverts commit a2723989bced503a4506684a4a6fdc6c8101f7b2.
* always sleep
* more cleanup
* little more
* fix linter
* little more
old-commit-hash: 0b5fd7287e
1 year ago
Justin Newberry
7f09117bf0
Revert "uploader cleanup" ( #31033 )
...
old-commit-hash: 5e4df41b2f
1 year ago
Adeeb Shihadeh
4580cd1eb9
uploader cleanup ( #31029 )
...
* cleanup
* startup cleanup
* step
* Update test_uploader.py
old-commit-hash: c6c6a441eb
1 year ago
Adeeb Shihadeh
59eb2988de
swaglog.py goes in common/ ( #30631 )
...
* swaglog.py goes in common/
* all of these go in release
* we'll even include the pyx
old-commit-hash: 35f819c823
1 year ago
Adeeb Shihadeh
e56998ca26
one more
...
old-commit-hash: c055fdc853
1 year ago
Dean Lee
00e5f37d2a
loggerd: c++ LoggerState ( #25869 )
...
* c++ LoggerState
* trigger ci
* trigger ci
* merge master
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3527c1da67
1 year ago
Justin Newberry
3027a428cb
Pytest: tici mark for skipping on-device tests ( #30412 )
...
* mark tici
* not those ones
* missed that one
* add those
* add pypoetry
* oops
old-commit-hash: aec7cea30d
1 year ago
Adeeb Shihadeh
61eb6f4f66
finish hardware move to system/ ( #30140 )
...
* finish hardware move to system/
* fix release
* couple more
old-commit-hash: c347096c3e
2 years ago
Shane Smiskol
13381ed446
services: capitalize constant service list ( #30005 )
...
* rename
* bump
* Apply suggestions from code review
old-commit-hash: 7f073483bb
2 years ago
Adeeb Shihadeh
1f8459d285
use pytest for cpp tests ( #29833 )
...
* add pytest-cpp package (#29828 )
* add pytest-cpp package
* disable for now
* use in ci
* use pytest cpp
* use my branch
* add missing tests
* that doesn't make sense
* it was merged upstream
* replace TEST_RLOG_URL with a publicly accessible url
* PR Cleanup
* assert instead
* update poetry lock
* add comment about pytest-cpp
---------
Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 2c1dfc2f34
2 years ago
Justin Newberry
dc6078a6c3
System: use paths for download folders too ( #29818 )
...
* use paths for download folders too
* trailing slash
* reset that
old-commit-hash: 73eda51a11
2 years ago
Justin Newberry
c7029ea15a
System: cleanup paths to use a common class ( #29816 )
...
* use OP prefix for logmessage
* cleanup paths too
* cleanup the paths too
* add hw.py to release
* fix those issues
* fix unittests
* fix unittests
* fix unittests
* do swaglog_ipc properly across all the files
* fix that
* fix swaglog in c++
* review suggestions
old-commit-hash: bfe990b112
2 years ago
Justin Newberry
e3053e6659
Tests: loggerd reduce iterations ( #29713 )
...
* reduce those iterations
* sleep time could be decreased too
* in case it's negative
old-commit-hash: a5ef9febb9
2 years ago
Adeeb Shihadeh
cc29c6640d
pytest: strict config ( #29676 )
...
* pytest: strict config
* collection works
* fixes
old-commit-hash: 72e2e2c9ec
2 years ago
Adeeb Shihadeh
16ec56398c
add openpilot prefix to imports ( #29498 )
...
* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b991
.
* fix pm test
old-commit-hash: a9626f95b6
2 years ago
Adeeb Shihadeh
f50fedb647
Fixes for PYTHONWARNINGS=error ( #29381 )
...
old-commit-hash: db287496d8
2 years ago
Justin Newberry
a14f162bc7
Ruff: comprehensions conventions ( #29317 )
...
ignore c408
old-commit-hash: 4a9afd7554
2 years ago
Cameron Clough
b120aec2f5
deleter: preserve flagged segments ( #28814 )
...
old-commit-hash: 98a30f10f4
2 years ago
Cameron Clough
182ef3fe52
loggerd: add types to tests and use pathlib ( #28943 )
...
old-commit-hash: 5d45d1fadc
2 years ago
Shane Smiskol
8a7283d315
uploader: check upload key value ( #28206 )
...
* fix check
* tests
* fix test
* fix
* xattr truthy and falsy tests
---------
Co-authored-by: Cameron Clough <cameronjclough@gmail.com>
old-commit-hash: 7f7637f3e5
2 years ago
Adeeb Shihadeh
2f8939dd0e
bootlog: log agnos partition hashes ( #28141 )
...
* bootlog: log agnos partition hashes
* full path
* trimming
* slot
* boot is big
* give some time to start
---------
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 1a3125bb8f
2 years ago
Harald Schäfer
515645da51
LaikaD new cache version ( #27596 )
...
old-commit-hash: 38cb42f76a
2 years ago
Adeeb Shihadeh
3a968c67e1
loggerd: move to system/ ( #27534 )
...
old-commit-hash: 94eb215980
2 years ago