a88eb06773
RawLogger: fix wrong pts ( #23205 )
...
old-commit-hash: cfad1f35e8
3 years ago
dd7c226097
util: move all functions into util namespace ( #23203 )
...
old-commit-hash: 9decd3d8a2
3 years ago
916c2ed588
loggerd: fix delayed exit from main thread
...
old-commit-hash: 5f36b48199
3 years ago
e7bf88f29f
Remove Raw Upload toggle ( #23143 )
...
* Remove Raw Upload toggle
* fix tests
old-commit-hash: 2e0c73fc0c
3 years ago
1ca1d7a673
increase loggerd per-cycle service limit to 200
...
old-commit-hash: f71a03f967
3 years ago
f8146db9b9
loggerd: don't let a single service clog up the main thread
...
old-commit-hash: baf1a77ca2
3 years ago
1473ec97da
LogCameraInfo: remove unused variables ( #23142 )
...
old-commit-hash: ddc612e9f6
3 years ago
3ba7f99688
move struct LogCameraInfo into loggerd.h ( #23129 )
...
old-commit-hash: 480fb54926
3 years ago
9e4cc1f7ff
Python: Replace more lists with generators ( #23116 )
...
* Replace lists with generators v2
* Replace set with {}
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Replace more set() with {}
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 6951b3271d
3 years ago
9b0fcaeb84
rename yuv streams ( #23071 )
...
* rename yuv streams
* bump cereal
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 348d2d2b0d
3 years ago
28dd415759
Do not run code on version.py import ( #23063 )
...
* Do not run code on version.py import
* fix athena
old-commit-hash: f7c46c6949
3 years ago
3b8daea061
Clear loggerd locks once on boot ( #23060 )
...
* add test for clear_locks
* move to bootlog
* simplify test
old-commit-hash: a2f32fd3e1
3 years ago
7f0beef092
loggerd: add test case for trigger_rotate ( #23038 )
...
* test rotate
* remove global LoggerdState
old-commit-hash: 1d323e0fd6
3 years ago
c1ef2b7493
loggerd: add test case for sync_encoders ( #23020 )
...
old-commit-hash: b5eb02181c
3 years ago
987f87cc0e
loggerd: split loggerd.cc into three files
...
old-commit-hash: 75dd0d6296
3 years ago
44568de155
faster jenkins ( #22973 )
...
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: e13630dfee
3 years ago
9399b6ae61
uploader: switch to upload_url v1.4 ( #22966 )
...
old-commit-hash: 23a1f47817
3 years ago
425349a55c
swaglog.py: respect LOGPRINT env variable ( #22950 )
...
* swaglog.py: respect LOGPRINT env variable
* only change handler that prints
* keep usefull manager prints
* only print running list
* revert process changes
* fix test
old-commit-hash: 77b334a698
3 years ago
35bfdce477
loggerd: trigger rotate on frame id instead of frame count ( #22848 )
...
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: ea761cbbd5
4 years ago
669ed5ff2b
Put journal and nvme stats in bootlog ( #22849 )
...
* Run commands and put output in bootlog
* log nvme
* fix indent
* cereal without event
* use regular array
old-commit-hash: fa0cbe5d40
4 years ago
48ed0e129e
loggerd/RawLogger: fix memory leak in encode_frame ( #22826 )
...
old-commit-hash: 0bd9aed82c
4 years ago
19deb98bc3
wshadow: fix comma three build
...
old-commit-hash: 45c506bb17
4 years ago
43e1903073
enable wshadow ( #22756 )
...
* enable wshadow (#22714 )
* fix replay
* more build fixes
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 5246f0231e
4 years ago
a031b938b0
replay: improve segment download and merge ( #22654 )
...
* no-cache mode
* fix test cases build error
* space
* don't create cache dir in no-cache mode
* fix errors in test cases
* no_local_cache_
* set the number of connections by chunk_size
* use size_t instead of int64_t
* add test case for no-cache mode
* rename variables
* fix SIGSEGV
* cleanup
* faster decompressBZ2
* always decompress bz2
* add test cases
* prepare for python interface
* fix test cases build error
* continue
* camera_replay: cache remote file
* protected inheritance
* single option name
* TODO
* test_case for LogReader&FrameReader
* fix wrong require
* test case for FileReader
* cleanup test
* test:fix wrong filename
* check cached file's checksum
* fix mkdir permissions err
cleanup filereader
* remove initialize libav network libraries.
dd
* abort all loading if one failed
* cleanup tests
* use threadpool to limit concurrent downloads
* cache more segments
* merge 3 segments for replay
* one segment uses about 100M of memory
* use segments_need_merge.size()
* shutdown
* fix stuck if exit replay before keyboard thread started
* load one segment at a time
* small cleanup
* cleanup filereader
* space
* tiny cleanup
* merge master
* cleanup test cases
* use util:create_directories
* cleanup framereader
old-commit-hash: 2b4a477fbc
4 years ago
ebffd5f3ad
util: add safe write functions ( #22160 )
...
* add safe write functions
* log error
* bzfile safe_fopen&safe_flush
* update test_case
* trigger ci
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 652c42da2c
4 years ago
0afe7d74bc
util: add new function create_directories with unit tests ( #21871 )
...
* util::create_directories
* check bool ret
* don't assume mask
* rename with_umask to no_umask
* remove umask
* rebase master
* rebase master
* 0755
old-commit-hash: 1f39d8cee6
4 years ago
c401d7aff3
loggerd: fix concurrency issues in sync encoders ( #22590 )
...
* sync_encoders
* add variable camera_synced
* cleanup
old-commit-hash: 18caf3535b
4 years ago
bb7751fdb0
don't set core affinity on PC ( #22706 )
...
old-commit-hash: 5b331fd6f5
4 years ago
0f77dd4506
loggerd: set encodeIdx.valid if frame id is correct ( #22634 )
...
* loggerd: set encodeIdx.valid if frame id is correct
* check valid flag in test
* test cleanup
* bump cereal
old-commit-hash: 89f311714c
4 years ago
b773f6711c
loggerd: always run encoders ( #22649 )
...
* loggerd: always run encoders
* fix raw logger
* bump loggerd cpu usage
old-commit-hash: 76bd932cf5
4 years ago
25cfa2b65a
tici: affine loggerd to efficiency cores ( #22581 )
...
old-commit-hash: 84de248fa7
4 years ago
66ca3985c9
replay : move utility functions into separate file ( #22414 )
...
* move functions into util
* read bz2 into stream
* pre-decompress log in the download thread
* cleanup logreader
* cache sha256 path
* use readBZ2file in test_logger
* Revert "cache sha256 path"
This reverts commit 60459d3ea09a2c80f4560cf95b1ce7d6af59f06d.
* use macro
* use ostringstream
* cleanup readBZ2File
* move precise_nano_sleep into util
old-commit-hash: d28b98c602
4 years ago
0cf0485912
small typo
...
old-commit-hash: 3ccf712ac9
4 years ago
c0356ffe9b
add log docs
...
old-commit-hash: 0f8c6f130b
4 years ago
d508125f35
Upload when on ethernet ( #22188 )
...
in addition to when on wifi
Co-authored-by: ntegan <nick@egan.gg>
old-commit-hash: 54b5972cf6
4 years ago
4844f8196d
remove loggerd todo about encodeIdx decimation
...
old-commit-hash: 377fe84948
4 years ago
33b378419a
loggerd: remove obsolete ethernetsniffer.py ( #22139 )
...
old-commit-hash: 8bca70878f
4 years ago
2dac83c02b
loggerd: remove obsolete testraw.cc ( #22138 )
...
old-commit-hash: 5a8ca8b449
4 years ago
e49dd50f98
Disable encoder sync logic if only one rotate camera present ( #22107 )
...
* disable sync logic if only one rotate camera
* consistent brackets
old-commit-hash: 48035e9535
4 years ago
60e7e09127
Ensure that first segment starts with all cameras on the same frameId ( #22096 )
...
* test that segment starts with the same frame id
* improve test
* add sync logic
* atomic max
* review comments
old-commit-hash: a93271a518
4 years ago
4c17c06799
Handle EINTR for all syscalls that can return it ( #21948 )
...
old-commit-hash: f02c8d0e2c
4 years ago
ecf3ee7603
loggerd: create encoder threads from cameras_logged ( #21875 )
...
old-commit-hash: d9baaf7eb9
4 years ago
0fac38e34f
LoggerState: test cases ( #21855 )
...
* test multiple threads writing to log
* fix typo
* use util::getenv
* check INIT_DATA and SENTINEL
* test END_OF_SEGMENT
* add comment
* test multiple threads logging and rotation
* cleanup
* update
* LoggerHandle:quick fix
* cleanup
* revert test_loggerd.py
* refactor test case
* check lock file
* check refcnt after close
* test_runner.cc
d
* int eixt_signal
old-commit-hash: 935cbd3139
4 years ago
6f92abc815
Less open file permissions ( #21922 )
...
* Less open file permissions
* add test back
* remove params test for permissions
* remove umask
* bump cereal
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dddab597bc
4 years ago
277bd43b15
Revert "tici: give loggerd rt priority ( #21503 )"
...
This reverts commit 0a50cf851e79342cf3db01033bc91516c504cbea.
old-commit-hash: 54a4eeb0fc
4 years ago
5c1d1ebe76
tici: give loggerd rt priority ( #21503 )
...
* give loggerd rt priority
* assert
* little more
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 7e2752c878
4 years ago
f65c7e7418
capnp:Text::Reader: use implicit conversion from string ( #21980 )
...
old-commit-hash: c6a34dd9f7
4 years ago
7d09945de3
BZFile: handle EINTR on BZ2_bzWrite ( #21949 )
...
old-commit-hash: b66e8adbef
4 years ago
aff7f0b1f3
enclose macro arguments in parentheses ( #21947 )
...
* macro argument should be enclosed in parentheses
* CL_CHECK
old-commit-hash: 4625098a79
4 years ago
9b1a7a6f01
use same env variable for loggerd, deleter, and uploader
...
old-commit-hash: 1d4b19f739
4 years ago
Dean Lee
Adeeb Shihadeh
Willem Melching
grekiki
Mayfield
Robbe Derks
ntegan1