For Immediate Release
June 4, 2024
Guelph ON, Canada – Connect Tech, a leading expert in embedded and edge AI computing, has introduced two new inference servers powered by NVIDIA® Jetson AGX Orin™ and Jetson Orin™ NX. Developed in collaboration with USES Integrated Solutions, the inference servers are high-performance, low-power AI workstations housed in a 2U chassis and driven by multiple NVIDIA Jetson Orin modules. These modules communicate via a Gigabit Ethernet fabric through a specialized managed Ethernet switch with a 4x SFP+ 10G uplink capability. The servers have an input power of 100~240 VAC (dual redundant) with a 1000W output each.
“The Connect Tech inference servers integrate 12 Jetson AGX Orin or 24 Jetson Orin NX modules into a powerful unified platform, delivering efficient connectivity and performance,” says Rob Callaghan, Chief Product Officer at Connect Tech. “With seamless network integration and 10G uplinks, they provide high-bandwidth, low-latency data paths for a wide range of inference applications. This upgrade brings cutting-edge AI technology to the edge, delivering powerful performance and efficiency for the most demanding tasks.”
Inference Server Powered by NVIDIA Jetson AGX Orin
This server supports 4, 8, or 12 Jetson AGX Orin module connectivity options. Each Jetson AGX Orin module delivers up to 275 TOPS of AI performance, equipped with a 2048-core NVIDIA Ampere architecture GPU and 64 Tensor Cores. Each module delivers high-performance computing, supported by a 12-core Cortex ARM CPU, 64GB memory, and external M.2 NVMe storage.
Inference Server Powered by NVIDIA Jetson Orin NX
This server supports 8, 16, or 24 Jetson Orin NX module connectivity options. Each Jetson Orin NX module provides up to 100 TOPS of AI performance, featuring a 1024-core NVIDIA Ampere architecture GPU and 32 Tensor Cores. Supported by an 8-core Cortex ARM CPU, 16GB memory, and external M.2 NVMe storage via x4 PCIe, these modules offer efficient computing capabilities.
Connect Tech and USES Integrated Solutions have collaborated on previous inference server projects, such as Jetson TX2 and Jetson AGX Xavier server offerings.
“From conception of the Jetson inference servers, Connect Tech was the obvious choice to help USES make this product a reality,” says Ryan Collis, Co-Founder & CEO of USES Integrated Solutions. “This collaboration leverages the strengths of both companies: USES’ experience creating innovative and scalable hardware and software solutions and Connect Tech’s position as a global leader with strong expertise of the NVIDIA Jetson platform. Together, we continue to advance inference server offerings and ensure that customers receive the highest quality products and support.”
Running NVIDIA’s most powerful deep learning software libraries, the servers solve the challenge of deploying edge solutions at scale. Building on the cloud-native support and modern AI stack of NVIDIA Jetson technologies, the inference servers create a resilient, manageable cluster using container orchestration technologies like Kubernetes. The integrated out-of-band management environment easily integrates each Jetson module’s power control into standard automation tools and provides remote access to each. Whether creating an edge micro-cluster or CI pipeline, the inference servers provide the foundation to automate edge or Jetson-powered strategies at scale.
Inference Servers Built for Versatile Applications
The servers are ideal for data centers, reducing rack-switching requirements and allowing for mass scalability. Additionally, their ruggedized chassis makes them well-suited for field deployment in industrial applications requiring real-time high-computing and data modeling. These GPU-accelerated machine learning and inferencing servers provide flexibility and cost efficiency in high-powered computing environments.
About Connect Tech
Connect Tech is a global leader in embedded computing solutions for a wide range of industries, including industrial automation, defense, robotics, transportation, and more. With a strong focus on innovation and customer satisfaction, Connect Tech offers a diverse portfolio of products designed to meet the demands of the most challenging embedded applications. For more information, visit www.connecttech.com.
About USES Integrated Solutions Inc.
USES Integrated Solutions Inc. specializes in developing uniquely scalable compute solutions, primarily focused on ARM SoCs, GPU, and alternative or emerging processor technologies. Through in-house mechanical, electrical, and software design and strategic partnerships with Industry leaders like Connect Tech, USES develops end-to-end computing solutions, ranging from ground-up custom designs to semi-custom integrations for the most unique workloads and environments. For more information, contact [email protected].