loggerd: switch to v4l encoder try 2 (#24380)
* start v4l encoder
* v4l encoder starts
* start and stop
* fill in proper controls
* it dequeued a buffer
* getting bytes
* it made a video
* it does make files
* getting close
* ahh, so that's how dequeue works
* qcam works (no remuxing)
* remuxing works
* we just need to make shutdown and rollover graceful
* graceful destruction
* switch to polling
* should work now
* fix pc build
* refactors, stop properly
* touchups, remove a copy
* add v4l encoder to release
* inlcude file
* move writing to it's own thread
* fix minor memory leak
* block instead of dropping frames
* add counter, fix tests maybe
* better debugging and test print
* print file path in assert
* format string in test
* no more oversized qlogs
* match qcam
* touchups, remove omx encoder
* remove omx include files
* checked ioctl, better debugging, open by name
* unused import
* move linux includes to third_party/linux/include
* simple encoderd
* full packet
* encoderd should be complete
* lagging print
* updates
* name dq thread
* subset idx
* video file writing works
* debug
* potential bugfix
* rotation works
* iframe
* keep writing support
* ci should pass
* loggerd, not encoderd
* remote encoder code
* support remote encoder
* cereal to master, add encoderd
* header no longer required
* put that back there
* realtime
* lower decoder latency
* don't use queue for VisionIpcBufExtra, disable realtime again
* assert all written
* hmm simpler
* only push to to_write if we are writing
* assert timestamp is right
* use at and remove assert
* revert to queue
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 0baa4c3e2ad9ee6f8daba8267db44c2cd44caa62
											 
										 
										
											4 years ago 
										
									 
								 
							 
							
								
							 
							
								 
							
							
								Import ( ' env ' ,  ' arch ' ,  ' cereal ' ,  ' messaging ' ,  ' common ' ,  ' visionipc ' ) 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								libs  =  [ common ,  cereal ,  messaging ,  visionipc , 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								        ' zmq ' ,  ' capnp ' ,  ' kj ' ,  ' z ' , 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								        ' avformat ' ,  ' avcodec ' ,  ' swscale ' ,  ' avutil ' , 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								        ' yuv ' ,  ' OpenCL ' ,  ' pthread ' ] 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								src  =  [ ' logger.cc ' ,  ' video_writer.cc ' ,  ' encoder/encoder.cc ' ,  ' encoder/v4l_encoder.cc ' ] 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								if  arch  !=  " larch64 " : 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  src  + =  [ ' encoder/ffmpeg_encoder.cc ' ] 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								if  arch  ==  " Darwin " : 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  # fix OpenCL 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  del  libs [ libs . index ( ' OpenCL ' ) ] 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  env [ ' FRAMEWORKS ' ]  =  [ ' OpenCL ' ] 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  # exclude v4l 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  del  src [ src . index ( ' encoder/v4l_encoder.cc ' ) ] 
  
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								logger_lib  =  env . Library ( ' logger ' ,  src ) 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								libs . insert ( 0 ,  logger_lib ) 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								env . Program ( ' loggerd ' ,  [ ' loggerd.cc ' ] ,  LIBS = libs ) 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								env . Program ( ' encoderd ' ,  [ ' encoderd.cc ' ] ,  LIBS = libs ) 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								env . Program ( ' bootlog.cc ' ,  LIBS = libs ) 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								
							 
						 
					
						
							
								
							 
							
								
									
										 
								
							 
							
								 
							
							
								if  GetOption ( ' extras ' ) : 
 
						 
					
						
							
								
							 
							
								
							 
							
								 
							
							
								  env . Program ( ' tests/test_logger ' ,  [ ' tests/test_runner.cc ' ,  ' tests/test_logger.cc ' ] ,  LIBS = libs  +  [ ' curl ' ,  ' crypto ' ] )