The VisiSonics 5/64 Audio/Visual Camera consists of 5 video cameras and 64 microphones mounted on the surface of an aluminum sphere. The spherical architecture and associated algorithms allow the creation of an omni-directional acoustic image of the environment. The 5 HD video cameras simultneously generate an associated omni-directional panoramic video stream of the captured environment. Audio and video are synchronized and co-registered as a combined stream using patented algorithms. The convergence of audio and video capture allows for the visualization of sound sources and their interaction with the environment to be understood in real-time.
VisiSonics 5/64 音视频声学相机由5个摄像机和64个麦克风组成,安装在一个铝合金球体表面。该球形结构和相关算法精准地复原了环境全景声像图,该5个高清视频摄像头同步工作从而捕获了全方位的环境视觉景观,采用了独特的专利算法能使音视频完美地结合起来,音视频的同步获取实现了声源的可视化,并且能对环境状况进行实时解析。
With the “Audio Camera,” and the FINDr software, users can capture, store, retrieve and process real-time integrated and synchronized audio and visual information. The captured data incorporates all aspects of the audio-visual world that an individual would experience if he or she were physically present where the Audio/Visual Camera were located. The processing software and storage system allows you to do this in real-time or to record sessions for post analysis.
使用声学相机和FINDr 软件,用户可以录制、存储、检索和处理实时集成和同步音视频资料,捕获的数据包含了音视频的全部信息,如果他或她在现场则能深刻地体验到这些。处理软件和存储系统能够让你实时地做这些事情,也可以录制下来供事后分析。
Audio Camera Applications
声学相机应用
·Noise Source Identification
噪声源识别
·Ambisonics
环境高保真度立体声
·Architectural Acoustics and Room Measurement
建筑声学和室内音质测量
·Telepresence
远场呈现
·Cross-Modal Attention and Saliency
跨模式备注和显著性
·Psychophysics
心理物理学
·Audio-Visual Tracking
音视频跟踪
·Audio/Visual Recording and Analysis
音视频记录和分析
·Meeting Recording
会议记录
·Intelligibility
清晰度
·Noise Measurement
噪声测量
5/64 Audio/Visual Camera In-Depth
5/64音视频全景声学相机
The AudioCamera’s spherical microphone architecture provides an omni-directional acoustic image of the environment.
声学相机的球面麦克风架构提供了一个全方位的环境声学图像。
The microphone signals are conditioned using individualized pre-amp circuits and then converted to digital by a dedicated analog to digital converter. The digitized acoustic data are sampled at 44.1 kHz per channel and collected by an internal high performance Field Programmable Gate Array (FPGA) based processor where they are managed, formatted and converted into a single USB 3.0 data stream. FINDr software, operating on a standard PC with an internal NVIDIA GPU, accepts the USB data stream and performs the user selected functions in real-time.
麦克风信号使用个性化的前置放大器电路,然后由专用的模拟数字转换器转换为数字信号。数字化的声学数据以每通道44.1 kHz采样,并由一个内部高性能现场可编程门阵列(FPGA)基于处理器收集,在那里他们被管理,格式化和转换成一个单一的USB 3.0数据流。FINDr软件在内置NVIDIA GPU的标准PC上运行,接受USB数据流并实时执行用户选择的功能。
The auditory scene can be decomposed into its spherical harmonic components up to order 7. This allows for increased spatial isolation of acoustic sources in the environment. Additionally, the scene can be decomposed into filtered plane-waves, and can be beamformed into multiple real-time beams. A resolution of up to two degrees is possible for higher frequency beams.
听觉场景可以分解成高达7阶的球面谐波分量。这使得声源在环境中的空间隔离度提高。另外,可以将场景分解为滤波后的平面波,并可以将其波束形成多个实时波束。高频波束的分辨率可以达到2度。
The video camera array generates an associated omni-directional panoramic visual scene that is synchronized with the live audio stream.
视频摄像机阵列(全景声学相机)生成了一个与实时音频流同步的相关全方位即全景视觉场景。
Five video cameras are integrated into the VisiSonics 5/64 Audio/Visual Camera to facilitate the panoramic scene capture. Each of the color video cameras has a resolution of 1328×1048 pixels. The captured video is synchronized with the audio data via an internal FPGA processor. The multi-camera image streams are collected via an internal USB 3.0 interface and sent to a laptop over a single USB 3.0 cable.
VisiSonics 5/64音频/视频摄像头集成了五个摄像头,以便于全景场景捕捉。每台彩色摄像头的分辨率为1328×1048像素。捕获的视频通过内部FPGA处理器与音频数据同步。多摄像头图像流通过内部USB 3.0接口收集,并通过一根USB 3.0电缆传输到笔记本电脑。
Included with the all Audio Cameras is the Frequency Identification and Noise Detector (FINDr) software.
所有的声学相机里都包含频率识别和噪声探测器(FINDr)软件。
With FINDr, you have the ability to visualize and analyze your recorded data. The FINDr software gives you instant access to an integrated audio/video panorama, and breaks down the data for you in helpful graphs for both time and frequency domain analysis.
使用FINDr,您可以可视化和分析记录的数据。FINDr软件使您能够即时访问集成的音频/视频全景图,并将数据分解为有用的图形,以便进行时域和频域分析。
See our Software page for more information.
更多的信息请参阅我们的软件页面