Introduction
This document describes how to set up and use multi-machine configuration when the special needs of a large studio environment apply.
If you are not yet familiar with the multi-machine topic in general, please read first.
The special needs and circumstances are usually these:
- You have multiple studios that have to be operational simultaneously.
- You have 5-10 or more cameras, each equipped with a tracking system, distributed across the studios.
- You have 5-10 or more renderer machines.
- You want to dynamically allocate which renderer machines are to be used when starting shooting in one of the studios.
- This implies that you want to dynamically route each of your cameras and tracking systems to an arbitrarily selected renderer machine.
System Architecture
It is recommended to build your system in a way that is similar to the example below.
This example shows an environment with 5 studios, 2 cameras + tracking per studio, and 10 renderer machines. (On the diagram we only depicted two of the studios, the other ones are represented by the "+" texts.)
Network
It is highly recommended to build two completely separated Ethernet LANs:
- one for the lagging-free transmitting of camera tracking data
- and another for the normal network data traffic which includes the controlling signals between the Aximmetry machines and the graphics, video, and other file transfer between the File Server and the renderer machines.
Internet access should also go through this second network for the machines that need it.
Routing the Camera and Tracking Signals
The goal is to enable dynamic routing of any camera and tracking system to any renderer machine.
Since the camera images are transferred via SDI we recommend using an SDI matrix device through which you can arrange any routing. This part of the system has to be operated separately, it cannot be controlled from the Aximmetry software.
However, the routing of camera tracking signals can be controlled from the software given that the tracking systems are either TCP-based or UDP-based and set up to send to broadcast or multicast IP addresses. See this later in the document.
File Server
Aximmetry entirely relies on the file system for storing the virtual scene, graphics, and video files. It is recommended to have a separate File Server machine that provides access to the files through one or more shared folders.
Also, it is recommended to have a Backup File Server in which all the data are reflected regularly.
Aximmetry Controlling Machines
Each studio should have its own controlling machine to allow operating on multiple shows simultaneously. These machines will provide the Aximmetry UI and will control the selected renderer machines.
Through the Data LAN, they access the virtual scene files stored on the File Server.
Aximmetry Renderer Machines
These perform the actual rendering and compositing of the virtual graphics. They can be dynamically allocated to any studio (controlling machine) and any camera.
These machines must have two network interface cards to connect to the two separate LANs.
Through the Data LAN, they access the virtual scene, graphics, and video files stored on the File Server. Through the Tracking LAN, they receive the camera tracking information. Through the SDI network, they receive the camera picture and other auxiliary video inputs and transmit the final composite image.
Designer Workstations
Graphics artists can design the required virtual 3D graphics on these machines.
Through the Data LAN, they access the virtual scene, graphics, and video files stored on the File Server.
Initial Setup of the Machines
Setting Up the File Server
On the File Server, create a folder to serve as the project root for Aximmetry. You can name it "AximmetryProjects" or anything else you prefer. Share this folder with full access for all users on the network. Ensure full access is confirmed for all network users before beginning the installation of Aximmetry instances.
Installing Aximmetry on All Machines
Aximmetry Broadcast SE/DE Edition has to be installed on all controlling, renderer, and designer machines.
For the DE Edition, you must also install Unreal Engine for Aximmetry on the renderer and designer machines. It is not necessary to install Unreal Engine on controlling machines if they will not perform any rendering tasks.
Additionally, you have to install the Common Library and, optionally, other libraries into the shared folder on the File Server.
Downloading All the Necessary Files
Pre-download all the necessary installers to streamline the installation process.
Log in to your Aximmetry account, go to Downloads, and download the required files:
NOTE: If you are using the SE Edition, you do not need to download Unreal Engine for Aximmetry and you will have to choose the AXIMMETRY BROADCAST SE in the above picture instead of DE.
Optionally, you may download other libraries for learning purposes, although they are not mandatory for the initial setup.
Installing Aximmetry SE/DE
Place all downloaded packages in the same folder as the Aximmetry_Broadcast_XX_XXXX.X.X.exe installer. Start the installer and follow the on-screen instructions.
When specifying the install location for libraries such as the mandatory Common Library, select the shared folder on the File Server:
After the first installation, the libraries will be available on the File Server, so you won't need to copy the libraries to subsequent machines. However, you have to copy and install the Aximmetry Broadcast installer and Unreal Engine for Aximmetry on the other computers.
NOTE: When installing from downloaded files, libraries and additions will not appear in the above Setup window; only the downloaded files will be shown.
Ensuring Access to Shared Device Configuration
In the shared projects folder on the File Server create a folder named DeviceSetups manually. E.g. based on the example above it will be at \\FileServer01\AximmetryProjects\DeviceSetups.
When this folder exists, it means that all Aximmetry instances on the controlling, renderer, and designer machines will see the same shared set of device configuration data, Calibration Profiles and camera presets (see below), instead of using a local user-specific set of them.
Setting Up the Controlling Machines
Note that if you use multiple Windows user accounts you have to perform these steps for each user.
Start Aximmetry Composer.
Go to the Preferences section. Make sure that the Project root folders list contains only one element which is the path of the shared folder on the File Server.
When you installed Aximmetry you already set this path. However, the installer only set it for the current Windows user. If you switch to another user account you will see a default path here. In this case, double-click the path and specify the shared folder to replace it.
Then go to the Remote Renderers section. Make sure that Local rendering is OFF, while Remote rendering is ON. This means that the controlling machine itself will not perform any rendering, it only controls the renderer machines which will do the actual work.
Click Start.
Select Edit > Preferences or press Ctrl + P.
Go to the Rendering section and select the Frame Size and Frame Rate that you generally use in your studio system:
Then go to the Channel Matrix section and check Unified multi-machine setup. This is the simplest way to ensure that output #1, #2, etc. means the same thing on all renderer machines when running a scene.
You can close Aximmetry Composer.
Setting Up the Renderer Machines
Renderer machines usually reside in a separate IT room and no direct access through monitor/keyboard is provided. Therefore log in to any of the controlling machines and use Remote Desktop to access the renderer machines.
Start Aximmetry Launcher from the Start menu. This application has to be always running on all renderer machines. It is the one that provides the connection between the controlling and the renderer machines. It is a user-level application so you have to keep logged in to Windows when you exit Remote Desktop.
Start Aximmetry Renderer Config from the Start menu.
In the Video Outputs section find the SDI output device through which you want to output the final composite image.
Assign index #2 to this device. It's IMPORTANT TO REMEMBER that you have to select #2, not #1. The reason is that the recommended standard wiring of Aximmetry scenes sends a preview/editing screen to output #1 and the final picture to output #2.
In the Mode field of the device click the three-dot button and select the video mode you generally use in your studio system:
Finally, check the Sync checkbox beside the device. IT'S VERY IMPORTANT. This will synchronize the rendering frame rate of the machine to the selected video mode.
Now go to the Device Mapper section and select the Video section:
For slot #1 select the SDI input device from which the camera input will be received. Leave mode on AUTO.
Optional: if you plan to use any auxiliary video inputs, for example for feeding virtual screens, map them to the #2, #3 etc. slots:
Click Save.
Setting Up the Tracking Systems
If a given tracking system is TCP based (e.g. NCam) then it does not need a special setup, all renderer machines will be able to connect to it.
If the given tracking system is UDP based (e.g. Free-D, Stype, Mo-sys, TrackMen, etc.) then its target IP has to be set either to broadcast or multicast IP. It means that all renderer machines will be able to receive the signal of all cameras.
If the tracking system's protocol includes a camera ID in the UDP packet (e.g. Free-D, Mo-sys) then all the systems of the same type can send the signal to the same target port, but they have to be set to different camera IDs.
If the tracking system's protocol does not include a camera ID in the UDP packet (e.g. Stype, TrackMen) then all the systems of the same type have to be set to different target port numbers.
Lens and Tracking Calibration
For each of your cameras with a tracking system, you must have the lens data (FOV, distortion, etc.) and the data describes the relation of the tracker to the camera (we call it "tracking calibration").
Some tracking systems, like Stype, Mo-sys, NCam, Trackmen, etc. provide their own calibration method performed by their own technicians. During the shooting these systems send full calibration data along with the positional data, so you do not need any additional setup in Aximmetry.
Other tracking systems, like the ones using Free-D, cannot send full calibration data, because the protocol does not allow it. They only send raw zoom/focus encoder data. In this case, you have to perform the calibration with Aximmetry's own Camera Calibrator application (see more info). The result of it will be a Calibration Profile file (stored in the shared DeviceSetups folder, see above) for each camera.
Defining Camera Presets in Aximmetry
In order to be able to route the camera tracking signals easily from Aximmetry, you have to define camera presets. It means that for each of your physical cameras you create a preset that contains
- a friendly name
- the parameters of the associated tracking system
- and the Calibration Profile that applies to that camera (only in the case of Free-D-like protocols).
Start Aximmetry Composer on one of the controlling machines. Go to the Remote Renderers section and click Manage Cameras.
Then click Add:
Give any friendly Name that makes it easy to identify the preset later:
Then click the three-dot button of the Tracking field:
Select the type of tracking system that is mounted to the camera in question. Let's assume it is Stype:
Double-click the item or click OK.
The different tracking systems have different sets of parameters. In the case of Stype, you only need a port through which its UDP packets are received. Specify the same port number you specified as the target port when you set up the specific Stype system that belongs to this camera.
Since Stype has its own internal calibration system you do not have to specify any Calibration Profile here. Just click OK.
The first preset has been added to the list.
As a second example let's define a camera with Free-D tracking. Repeat the same steps, but choose Free-D from the list.
Besides the UDP port, it also has a Camera ID parameter. Again set these to the same values you set up the tracking system with.
In the case of Free-D, you also have to specify a Calibration Profile. Click the three-dot button in the Calibration Profile field:
The list of profiles you previously created with Aximmetry Camera Calibrator appears. Select the one that applies to this camera.
Double-click the item or click OK.
You have the full preset, click OK.
Suppose you have ten cameras, two per studio, six with Stype, and four with Free-D. Then your final preset list will look something like this:
Click OK to save the list.
Using the System When Shooting a Show
Log in to the controlling machine associated with the studio you want the shooting performed in.
Start Aximmetry Composer.
Go to the Remote Renderers section. The list of all the available renderer machines will be populated automatically.
means that the machine is currently free to use; it is not used by any other controlling machine.
means that the machine is currently occupied; it is rendering for another controlling machine.
Suppose you want to do a two-camera shoot in your studio. For that select, any two of the Idle renderer machines and assign them the #1 and #2 indices.
NOTE: Upon changing an index the list is automatically reordered. The machines with indexes will always be listed at the top ordered by the index.
After selecting Axi-Renderer-05 and 06 as #1 and #2 you will see this:
This means that later on your Aximmetry UI the Remote #1 and Remote #2 designations will refer to these two machines.
Routing Tracking Systems Dynamically
The next step is assigning the cameras you will work with to the selected renderer machines. For that simply select the camera preset that belongs to the desired camera from the Cameras drop-down list.
Do the same for the other camera as well. You will get:
PLEASE NOTE that this step only takes care of the routing of the tracking system signals, not the camera video signals themselves!
At this point you have finished setting up the remote renderers in Aximmetry, you can click Start.
Note that Aximmetry remembers your choices. Next time you start Aximmetry you will see the same assignments in the list.
However, it is possible that you will see something like this:
The red label indicates that one of the renderer machines you previously used is now occupied by another studio. In this case, you simply have to assign index #2 to another free machine.
It is also possible that you get something like this:
means that the machine is currently unreachable; it is either down or has connection issues. This should not occur normally. In this case, you have to do the same: select another machine.
Routing Cameras and Other SDI Signals Dynamically
The routing of SDI signals cannot be controlled from Aximmetry. It has to be arranged separately on the SDI matrix.
The Proper Settings of the Virtual Scenes
In order to have all the settings described above in this document work properly you have to make sure that in all loaded Aximmetry scenes the input and output parameters are set in the following way.
Note that you only have to do this setup once for each scene. Then you save the scene, and these setting will always apply after.
Go to the INPUTS control board.
For all INPUT X panels make sure that both Camera Device and Tracking Device are set to Mapped: #1. This ensures that the input mappings you did on the renderer machines and the selected camera presets are in effect on all machines.
In virtual camera compounds, for each INPUT X panel select a corresponding renderer machine in the Engine property. This assigns the processing of the corresponding input to the selected machine.
....... and so on depending on how many renderers you use.
NOTE: Since Aximmetry Version 2024.2.0, the tracked cameras (AR, LED Wall, and tracked green cameras) do not have an Engine setting for the INPUT panel. Instead, they are also defined by the SELECT CAMERA's engine as discussed below.
Go to the CAMERAS control board.
On the SELECT CAMERA panel set all the Cam X Engine properties to the corresponding renderer machine.
Operation Safety
Please follow this documentation.