Adeeb Shihadeh
b33342c18f
loggerd: limit encoded queue size ( #34837 )
...
* loggerd: limit encoded queue size
* less spammy
2 months ago
Dean Lee
c52112ad4e
loggerd: eliminate recursion from handle_encoder_msg ( #33453 )
...
* refactor handle_encoder_msg
* removing the recursion only
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2 months ago
Adeeb Shihadeh
6f5f8e7746
loggerd: reduce debug log frequency
2 months ago
Dean Lee
d802a423a6
loggerd: Initialize atomic variables to zero ( #33130 )
...
Initialize atomic variables in LoggerdState to zero
old-commit-hash: 8f3fc699d4
9 months ago
Harald Schäfer
f870a968e9
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
old-commit-hash: e71ec4e8d7
11 months ago
Adeeb Shihadeh
2632a41c1e
encoderd: get frame size over vipc ( #31276 )
...
* encoderd: get frame size over vipc
* bump cereal
* fix ffmpeg
* no print
old-commit-hash: a5766e2796
1 year ago
Adeeb Shihadeh
6124ecf1c1
uploader: restrict qcam upload on metered connctions ( #31047 )
...
* uploader: restrict qcam upload on metered connctions
* route requesting
* rename
* str
* cleanup
* strip dongle
* upload bookmarked segments
---------
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2280ac50b7
1 year ago
Dean Lee
00e5f37d2a
loggerd: c++ LoggerState ( #25869 )
...
* c++ LoggerState
* trigger ci
* trigger ci
* merge master
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3527c1da67
1 year ago
Justin Newberry
dc6078a6c3
System: use paths for download folders too ( #29818 )
...
* use paths for download folders too
* trailing slash
* reset that
old-commit-hash: 73eda51a11
2 years ago
Kacper Rączy
4040d85159
encoderd: fix crash when filename is null ( #29748 )
...
Use publish_name for thread name and debugging messages
old-commit-hash: 0bda43d71c
2 years ago
Dean Lee
56b582a059
cpplint: add filter `whitespace/forcolon` ( #29582 )
...
whitespace/forcolon
old-commit-hash: ac93902983
2 years ago
Adeeb Shihadeh
6b2ffe9490
bump cereal ( #29561 )
...
old-commit-hash: e726505918
2 years ago
Dean Lee
97e9d55588
cpplint: `build/include_what_you_use` ( #29556 )
...
* include_what_you_use
* remove comments
* include <memory>
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 2d99521e75
2 years ago
Vivek Aithal
8d11558056
[commabody] setup and run live stream encoders ( #29087 )
...
* op changes needed for body
* remove logmessaged callback
* add newlines
* add stream arg
* add stream_encoder to config
* supersets, avoid two encoderd
* fix recursive exit error
* fix loggerd crash
* add stream_encoderd cpu usage to test
* Update system/loggerd/loggerd.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* resolve comments
* stream_encoderd onroad to false
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 81322a4805
2 years ago
Dean Lee
b80325aa04
swaglog: enable type-checked against format string ( #29096 )
...
* check&fix fmt
* bump rednose
* correct format string
* bump rednose
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 940954c13e
2 years ago
Dean Lee
c4aeaba7c6
loggerd: check `userFlag` outside the while loop ( #29095 )
...
* improve check userFlag
* rename to ServiceState
* setxattr once
old-commit-hash: c0c00e1997
2 years ago
Cameron Clough
b120aec2f5
deleter: preserve flagged segments ( #28814 )
...
old-commit-hash: 98a30f10f4
2 years ago
Dean Lee
b59b27e01e
loggerd/encoder: refactor constructors to take EncoderInfo as parameter ( #28921 )
...
* refactor constructors to take EncoderInfo as parameter
* remove last arg codec
* use macro to init function pointers
old-commit-hash: 713d2ec586
2 years ago
Dean Lee
0ac70b51fa
loggerd: pass `encoder_info` by reference ( #28694 )
...
old-commit-hash: 36fe84ccdd
2 years ago
Harald Schäfer
e841a5ef81
Encoderd: refactor msg getters and setters ( #28509 )
...
* Encoderd: refactor msg getters and setters
* whitespace
* whitespace
* whitespace
old-commit-hash: 2453d3a04b
2 years ago
Harald Schäfer
1581ba80f8
Encoderd: give every camera stream list of encoder streams ( #28480 )
...
* Compiles
* fixed something
* CLEANUP
* todo
* More cleanup
* Add TODO
* Update loggerd.cc
* remove write here too
old-commit-hash: ac45b77d3b
2 years ago
Adeeb Shihadeh
3a968c67e1
loggerd: move to system/ ( #27534 )
...
old-commit-hash: 94eb215980
2 years ago
Adeeb Shihadeh
a4306c955f
loggerd: rotate if segment length is >20% longer than expected ( #27193 )
...
* loggerd: rotate if segment length is >20% expected
* add that back
* comment
---------
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2ecdb2857e
2 years ago
Jake Poznanski
e708055ca2
loggerd: fix length of ArrayPtr in handle_encoder_msg ( #26077 )
...
old-commit-hash: c782e4d796
3 years ago
Dean Lee
e9f2954ee5
loggerd: remove 'enable' from struct LogCameraInfo ( #25052 )
...
remove enalbe
old-commit-hash: 568cc0f892
3 years ago
Dean Lee
1b725b5005
loggerd: remove rotate_lock ( #24969 )
...
remove lock
old-commit-hash: 748bbac344
3 years ago
Willem Melching
753045c73d
less TICI when not needed ( #24698 )
...
* less TICI when not needed
* fix process replay
* move reading voltages into hw abstraction layer
* Update selfdrive/hardware/tici/hardware.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Update selfdrive/hardware/hw.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Update selfdrive/hardware/base.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* rename init function
* Update selfdrive/athena/athenad.py
Co-authored-by: Robbe Derks <robbe.derks@gmail.com>
* Update selfdrive/boardd/boardd.cc
* Apply suggestions from code review
* Update selfdrive/thermald/thermald.py
* update ref
* fix alert width if all cameras are bad
* add ecam to test_loggerd
* bump cereal
* bump cereal
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Robbe Derks <robbe.derks@gmail.com>
old-commit-hash: f49a9c9fd2
3 years ago
George Hotz
109916df80
loggerd: Fix loggerd encode packet drops ( #24599 )
...
* hmm, try this
* hmm, try this
* rewrite handle_encoder_msg
* fix new logic
* add comments and an assert
* handle startup condition better
* handle restarts of encoderd
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 0000ad2ac0
3 years ago
George Hotz
a053d070be
encoderd: enable ( #24492 )
...
* enable encoderd
* correct enable line
* fix loggerd tests
* fix power draw and cpu tests
* correct cpu for encoderd
* fix a bug, video_writer is shared
* fix issue with not recording dcam
* add recording state
* wooo tests pass. encode id keeps counting
* core 3
* loggerd then encoderd
* stop loggerd first
* core 3 always online
* see the camera when we see encoder packet
* encoderd on small core uses 37%
* remove encoder logic from loggerd
* delete unit test that doesn't really make sense anymore
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 94b9972eb7
3 years ago
George Hotz
eb9e57e070
encoderd: support remote encoder behind env var ( #24490 )
...
* remote encoder
* remote encoder on PC, fix type
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: bd0cc655fb
3 years ago
George Hotz
1f4628bad5
encoderd: make work on PC ( #24483 )
...
* don't use the codec in video_writer
* this produces broken videos for some reason
* bugfix
* refactor on the class
* works on device
* fix codec
* no codec enum
* fix pc
* move into dirs
* these includes also
* rename it ffmpegencoder
* add avcodec_close
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2008db47c2
3 years ago
Willem Melching
be08693d5c
delay bz2 compression from logging to uploading ( #24392 )
...
* remove log_name
* log without compression
* fix tests
* remove extension for bootlog
* another test fix
* uploader compresses
* also compress in athena
* only compress qlog
* more generic check in do_upload
* fix bootlog compression
* lower loggerd cpu usage
* dont link against bz2
* set core affinity to little cluster
* handle old files
old-commit-hash: 77a6f3d034
3 years ago
George Hotz
7119a98414
loggerd: switch to v4l encoder try 2 ( #24380 )
...
* start v4l encoder
* v4l encoder starts
* start and stop
* fill in proper controls
* it dequeued a buffer
* getting bytes
* it made a video
* it does make files
* getting close
* ahh, so that's how dequeue works
* qcam works (no remuxing)
* remuxing works
* we just need to make shutdown and rollover graceful
* graceful destruction
* switch to polling
* should work now
* fix pc build
* refactors, stop properly
* touchups, remove a copy
* add v4l encoder to release
* inlcude file
* move writing to it's own thread
* fix minor memory leak
* block instead of dropping frames
* add counter, fix tests maybe
* better debugging and test print
* print file path in assert
* format string in test
* no more oversized qlogs
* match qcam
* touchups, remove omx encoder
* remove omx include files
* checked ioctl, better debugging, open by name
* unused import
* move linux includes to third_party/linux/include
* simple encoderd
* full packet
* encoderd should be complete
* lagging print
* updates
* name dq thread
* subset idx
* video file writing works
* debug
* potential bugfix
* rotation works
* iframe
* keep writing support
* ci should pass
* loggerd, not encoderd
* remote encoder code
* support remote encoder
* cereal to master, add encoderd
* header no longer required
* put that back there
* realtime
* lower decoder latency
* don't use queue for VisionIpcBufExtra, disable realtime again
* assert all written
* hmm simpler
* only push to to_write if we are writing
* assert timestamp is right
* use at and remove assert
* revert to queue
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 0baa4c3e2a
3 years ago
George Hotz
6dde52671b
loggerd: prereqs for deanlee loggerd omx encoder (try 2) ( #24252 )
...
* refactor encoders
* fix pc build
* buf_info
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 0ac35a656a
3 years ago
George Hotz
9720bb37b5
loggerd: broadcast encoder data ( #24177 )
...
* encode data try 1
* fix pc build
* low quality compressed streamer with pyav
* nvidia streamer
* timestamp support
* fix latency measurement
* refactor
* camerastream updates
* fix linter
* compressed to vipc, clean
* remove print
* touchups
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: dab978083b
3 years ago
George Hotz
0681a415e9
broadcast encode idx packets ( #24176 )
...
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: cc8430b668
3 years ago
Adeeb Shihadeh
1c4b6e38e9
loggerd: less error logging
...
old-commit-hash: 652ef27a72
3 years ago
Dean Lee
3e72a81dac
Use std::unique_ptr to manage memory ( #23168 )
...
* use unique_ptr
* trigger ci
* move down loggerdstate
old-commit-hash: 4aa291c406
3 years ago
Dean Lee
dd7c226097
util: move all functions into util namespace ( #23203 )
...
old-commit-hash: 9decd3d8a2
3 years ago
Adeeb Shihadeh
916c2ed588
loggerd: fix delayed exit from main thread
...
old-commit-hash: 5f36b48199
3 years ago
Adeeb Shihadeh
1ca1d7a673
increase loggerd per-cycle service limit to 200
...
old-commit-hash: f71a03f967
3 years ago
Adeeb Shihadeh
f8146db9b9
loggerd: don't let a single service clog up the main thread
...
old-commit-hash: baf1a77ca2
3 years ago
Willem Melching
3b8daea061
Clear loggerd locks once on boot ( #23060 )
...
* add test for clear_locks
* move to bootlog
* simplify test
old-commit-hash: a2f32fd3e1
3 years ago
Dean Lee
7f0beef092
loggerd: add test case for trigger_rotate ( #23038 )
...
* test rotate
* remove global LoggerdState
old-commit-hash: 1d323e0fd6
3 years ago
Dean Lee
987f87cc0e
loggerd: split loggerd.cc into three files
...
old-commit-hash: 75dd0d6296
3 years ago
Adeeb Shihadeh
35bfdce477
loggerd: trigger rotate on frame id instead of frame count ( #22848 )
...
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: ea761cbbd5
3 years ago
Mayfield
43e1903073
enable wshadow ( #22756 )
...
* enable wshadow (#22714 )
* fix replay
* more build fixes
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 5246f0231e
4 years ago
Dean Lee
c401d7aff3
loggerd: fix concurrency issues in sync encoders ( #22590 )
...
* sync_encoders
* add variable camera_synced
* cleanup
old-commit-hash: 18caf3535b
4 years ago
Adeeb Shihadeh
bb7751fdb0
don't set core affinity on PC ( #22706 )
...
old-commit-hash: 5b331fd6f5
4 years ago
Willem Melching
0f77dd4506
loggerd: set encodeIdx.valid if frame id is correct ( #22634 )
...
* loggerd: set encodeIdx.valid if frame id is correct
* check valid flag in test
* test cleanup
* bump cereal
old-commit-hash: 89f311714c
4 years ago