The automotive industry is currently on the cusp of a radical evolution, steering towards a future where cars are not just vehicles but sophisticated, software-defined vehicles (SDV). This shift is marked by an increased reliance on automation and a significant increase in the use of sensors to improve safety and reliability. However, the increasing number of sensors has led to higher compute demands and poses challenges in managing a wide variety of data. The traditional method of using separate processors to manage each sensor's data is becoming obsolete. The current trends necessitate a unified processing system that can deal with multimodal sensor data, utilizing traditional Digital Signal Processing (DSP) and AI-driven algorithms. This approach allows for more efficient and reliable sensor fusion, significantly enhancing vehicle perception. Developers often face difficulties adhering to stringent power, performance, area, and cost (PPAC) and timing constraints while designing automotive SoCs.

Cadence, with its groundbreaking products and AI-powered processors, is enabling designers and automotive manufacturers to meet the future sensor fusion demands within the automotive sector. At the recent CadenceLive Silicon Valley 2024, Amol Borkar, product marketing director at Cadence, showcased the company's dedication and forward-thinking solutions in a captivating presentation titled "Addressing Tomorrow’s Sensor Fusion Needs in Automotive Computing with Cadence." This blog aims to encapsulate the pivotal takeaways from the presentation. If you missed the chance to watch this presentation live, please click here to watch it.

Significant Trends in the Automotive Market – Industry Landscape

We are witnessing a revolution in automotive technology. Innovations like occupant and driver monitoring systems (OMS, DMS), 4D radar imaging, LiDAR technology, and 360-degree view are pushing the boundaries of what's possible, leading us into an era of remarkable autonomy levels—ranging from no feet or hands required to eventually no eyes needed on the road.

Sensor Fusion and Increasing Processing Demands—Sensor fusion effectively integrates data from different sensors to help vehicles understand their surroundings better. Its main benefit is in overcoming the limitations of individual sensors. For example, cameras provide detailed visual information but struggle in low-light or lousy weather. On the other hand, radar is excellent at detecting objects in these conditions but lacks the detail that cameras provide. By combining the data from multiple sensors, automotive computing can take advantage of their strengths while compensating for their weaknesses, resulting in a more reliable and robust system overall.

One thing to note is that the increased number of sensors produces various data types, leading to more pre-processing.

On-Device Processing—As the industry moves towards autonomy, there is an increasing need for on-device data processing instead of cloud computing to enable vehicles to make informed decisions. Embracing on-device processing is a significant advancement for facilitating real-time decisions and avoiding round-trip latency.

AI Adoption—AI has become integral to automotive applications, driving safety, efficiency, and user experience advancements. AI models offer superior performance and adaptability, making future-proofing a crucial consideration for automotive manufacturers. AI significantly enhances sensor fusion algorithms, offering scalability and adaptability beyond traditional rule-based approaches. Neural networks enable various fusion techniques, such as early fusion, late fusion, and mid-fusion, to optimize the integration and processing of sensor data.

Future Sensor Fusion Needs

Automotive architectures are continually evolving. With current trends and AI integration into radar and sensor fusion applications, SoCs should be modular, flexible, and programmable to meet market demands.

Heterogeneous Architecture- Today's vehicles are loaded with various sensors, each with a unique processing requirement. Running the application on the most suitable processor is essential to achieve the best PPA. To meet such requirements, modern automotive solutions require a heterogeneous compute approach, integrating domain-specific digital signal processors (DSPs), neural processing units (NPUs), central processing unit (CPU) clusters, graphics processing unit (GPU) clusters, and hardware accelerator blocks. A balanced heterogeneous architecture gives the best PPA solution.

Flexibility and Programmability- The industry has come a long way from using computer vision algorithms such as HOG (Histogram Oriented Gradient) to detect people and objects, HAR classifier to detect faces, etc., to CNN and LSTM-based AI to Transformer models and graphical neural networks (GNN). AI has evolved tremendously over the last ten years and continues to evolve. To keep up with the evolving rate of AI, SoC design must be flexible and programmable for updates if needed in the future.

Addressing the Sensor Fusion Needs with Cadence

Cadence offers a complete suite of hardware and software products to address the increasing compute requirements in automotive. The comprehensive portfolio of Tensilica products built on the robust 32-bit RISC architecture caters to various automotive CPU and AI needs. What makes them particularly appealing is their scalability, flexibility, and configurability, offering many options to meet diverse needs.

The Xtensa family of products offers high-quality, power-efficient CPUs. Tensilica family also includes AI processors like Neo NPUs for the best power, performance, and area (PPA) for AI inference on devices or more extensive applications. Cadence also offers domain-specific products for DSPs such as HIFI DSPs, specialized DSPs and accelerators for radar and vision-based processing, and a general-purpose family of products for floating point applications.

The ConnX family offers a wide range of DSPs, from compact and low-power to high-performance, optimized for radar, lidar, and communications applications in ADAS, autonomous driving, V2X, 5G/LTE/4G, wireless communications, drones, and robotics. Tensilica's ISO26262 certification ensures compliance with automotive safety standards, making it a trusted partner for advanced automotive solutions. The Cadence NeuroWeave Software Development Kit (SDK) provides customers with a uniform, scalable, and configurable ML interface and tooling that significantly improves time to market and better prepares them for a continuously evolving AI market. Cadence Tensilica offers an entire ecosystem of software frameworks and compilers for all programming styles.

Tensilica's comprehensive software stack supports programming for DSPs, NPUs, and accelerators using C++, OpenCL, Halide, and various neural network approaches. Middleware libraries facilitate applications such as SLAM, radar processing, and Eigen libraries, providing robust support for automotive software development.

Conclusion

Cadence’s Tensilica products offer a development toolchain and various IPs tailored for the automotive industry, covering audio, vision, radar, unified DSPs, and NPUs. With ISO certification and a robust partner ecosystem, Tensilica solutions are designed to meet the future needs of automotive computing, ensuring safety, efficiency, and innovation.

Learn More

• Cadence Automotive Solutions
• Cadence Automotive IP
• Sensor Fusion and ADAS in TSMC Automotive Processes
• Revolution on the Road: How Cadence is Driving the Future of Automotive Design!
• Taming Design Complexity in Chiplet-Based Automotive Electronics
• UCIe and Automotive Electronics: Pioneering the Chiplet Revolution

The COVID-19 pandemic has highlighted the critical role of genomic surveillance for guiding policy and control. Timeliness is key, but sequence alignment and phylogeny slow most surveillance techniques. Millions of SARS-CoV-2 genomes have been assembled. Phylogenetic methods are ill equipped to handle this sheer scale. We introduce a pangenomic measure that examines the information diversity of a k-mer library drawn from a country's complete set of clinical, pooled, or wastewater sequence. Quantifying diversity is central to ecology. Hill numbers, or the effective number of species in a sample, provide a simple metric for comparing species diversity across environments. The more diverse the sample, the higher the Hill number. We adopt this ecological approach and consider each k-mer an individual and each genome a transect in the pangenome of the species. Structured in this way, Hill numbers summarize the temporal trajectory of pandemic variants, collapsing each day's assemblies into genome equivalents. For pooled or wastewater sequence, we instead compare days using survey sequence divorced from individual infections. Across data from the UK, USA, and South Africa, we trace the ascendance of new variants of concern as they emerge in local populations well before these variants are named and added to phylogenetic databases. Using data from San Diego wastewater, we monitor these same population changes from raw, unassembled sequence. This history of emerging variants senses all available data as it is sequenced, intimating variant sweeps to dominance or declines to extinction at the leading edge of the COVID-19 pandemic.

Mitochondrial dysfunction is a hallmark of many genetic neurodegenerative diseases, but therapeutic options to reverse mitochondrial dysfunction are limited. While recent studies support the possibility of improving mitochondrial fusion/fission dynamics and motility to correct mitochondrial dysfunction and resulting neurodegeneration in Charcot-Marie-Tooth disease (CMT) and other neuropathies, the clinical utility of reported compounds and relevance of preclinical models are uncertain. Here, we describe motor and sensory neuron dysfunction characteristic of clinical CMT type 2 A in a CRISPR/Casp-engineered Mfn2 Thr105Met (T105M) mutant knock-in mouse. We further demonstrate that daily oral treatment with a novel mitofusin activator derived from the natural product piperine can reverse these neurologic phenotypes. Piperine derivative 8015 promoted mitochondrial fusion and motility in Mfn2-deficient cells in a mitofusin-dependent manner and reversed mitochondrial dysfunction in cultured fibroblasts and reprogrammed motor neurons from a human CMT2A patient carrying the MFN2 T105M mutation. Like previous mitofusin activators, 8015 exhibited stereospecific functionality, but the more active stereoisomer, 8015-P2, is unique in that it has subnanomolar potency and undergoes entero-hepatic recirculation which extends its in vivo half-life. Daily administration of 8015-P2 to Mfn2 T105M knock-in mice for 6 weeks normalized neuromuscular and sensory dysfunction and corrected histological/ultrastructural neurodegeneration and neurogenic myoatrophy. These studies describe a more clinically relevant mouse model of CMT2A and an improved mitofusin activator derived from piperine. We posit that 8015-P2 and other piperine derivatives may benefit CMT2A or other neurodegenerative conditions wherein mitochondrial dysdynamism plays a contributory role.

Designing a sensory-friendly bedroom for a child with autism is essential in creating a calming and functional environment that caters to their unique sensory needs. Sensory processing challenges are common among children with autism, meaning that their surroundings can either help regulate their emotions or lead to sensory overload. While companies like Interactive 365 provide […]

The post How To Set Up The Perfect Sensory Bedroom For Kids With Autism appeared first on Chart Attack.

Sweat: We all do it. It plays an essential role in controlling body temperature by cooling the skin through evaporation. But it can also carry salts and other molecules out of the body in the process. In medieval Europe, people would lick babies; if the skin was salty, they knew that serious illness was likely. (We now know that salty skin can be an indicator for cystic fibrosis.)

Scientists continue to study how the materials in sweat can reveal details about an individual’s health, but often they must rely on gathering samples from subjects during strenuous exercise in order to get samples that are sufficiently large for analysis.

Now researchers in China have developed a wearable sensor system that can collect and process small amounts of sweat while providing continuous detection. They have named the design a “skin-interfaced intelligent graphene nanoelectronic” patch, or SIGN for short. The researchers, who described their work in a paper published in Advanced Functional Materials, did not respond to IEEE Spectrum’s interview requests.

The SIGN sensor patch relies on three separate components to accomplish its task. First, the sweat must be transported from the skin into microfluidic chambers. Next, a special membrane removes impurities from the fluid. Finally, this liquid is delivered to a bioreceptor that can be tuned to detect different metabolites.

The transport system relies on a combination of hydrophilic (water-attracting) and hydrophobic (water-repelling) materials. This system can move aqueous solutions along microchannels, even against gravity. This makes it possible to transport small samples with precision, regardless of the device’s orientation.

The fluid is transported to a Janus membrane, where impurities are blocked. This means that the sample that reaches the sensor is more likely to produce accurate results.

Finally, the purified sweat arrives at a flexible biosensor. This graphene sensor is activated by enzymes designed to detect the desired biomarker. The result is a transistor that can accurately measure the amount of the biomarker in the sample.

At its center, the system has a membrane that removes impurities from sweat and a biosensor that detects biomarkers.Harbin Institute of Technology/Shenyang Aerospace University

One interesting feature of the SIGN patch is that it can provide continuous measurements. The researchers tested the device through multiple cycles of samples with known concentrations of a target biomarker, and it was about as accurate after five cycles as it was after just one. This result suggests that it could be worn over an extended period without having to be replaced.

Continuous measurements can provide useful longitudinal data. However, Tess Skyrme, a senior technology analyst at the research firm IDTechEx, points out that continuous devices can have very different sampling rates. “Overall, the right balance of efficient, comfortable, and granular data collection is necessary to disrupt the market,” she says, noting that devices also need to optimize “battery life, calibration, and data accuracy.”

The researchers have focused on lactate—a metabolite that can be used to assess a person’s levels of exercise and fatigue—as the initial biomarker to be detected. This function is of particular interest to athletes, but it can also be used to monitor the health status of workers in jobs that require strenuous physical activity, especially in hazardous or extreme working conditions.

Not all experts are convinced that biomarkers in sweat can provide accurate health data. Jason Heikenfeld, director of the Novel Device Lab at the University of Cincinnati, has pivoted his research on wearable biosensing from sweat to the interstitial fluid between blood vessels and cells. “Sweat glucose and lactate are way inferior to measures that can be made in interstitial fluid with devices like glucose monitors,” he tells Spectrum.

The researchers also developed a package to house the sensor. It’s designed to minimize power consumption, using a low-power microcontroller, and it includes a Bluetooth communications chip to transmit data wirelessly from the SIGN patch. The initial design provides for 2 hours of continuous use without charging, or up to 20 hours in standby mode.

For people with diabetes, glucose monitors are a valuable tool to monitor their blood sugar. The current generation of these biosensors detect glucose levels with thin, metallic filaments inserted in subcutaneous tissue, the deepest layer of the skin where most body fat is stored.

Medical technology company Biolinq is developing a new type of glucose sensor that doesn’t go deeper than the dermis, the middle layer of skin that sits above the subcutaneous tissue. The company’s “intradermal” biosensors take advantage of metabolic activity in shallower layers of skin, using an array of electrochemical microsensors to measure glucose—and other chemicals in the body—just beneath the skin’s surface.

Biolinq just concluded a pivotal clinical trial earlier this month, according to CEO Rich Yang, and the company plans to submit the device to the U.S. Food and Drug Administration for approval at the end of the year. In April, Biolinq received US $58 million in funding to support the completion of its clinical trials and subsequent submission to the FDA.

Biolinq’s glucose sensor is “the world’s first intradermal sensor that is completely autonomous,” Yang says. While other glucose monitors require a smartphone or other reader to collect and display the data, Biolinq’s includes an LED display to show when the user’s glucose is within a healthy range (indicated by a blue light) or above that range (yellow light). “We’re providing real-time feedback for people who otherwise could not see or feel their symptoms,” Yang says. (In addition to this real-time feedback, the user can also load long-term data onto a smartphone by placing it next to the sensor, like Abbott’s FreeStyle Libre, another glucose monitor.)

More than 2,000 microsensor components are etched onto each 200-millimeter silicon wafer used to manufacture the biosensors.Biolinq

Biolinq’s hope is that its approach could lead to sustainable changes in behavior on the part of the individual using the sensor. The device is intentionally placed on the upper forearm to be in plain sight, so users can receive immediate feedback without manually checking a reader. “If you drink a glass of orange juice or soda, you’ll see this go from blue to yellow,” Yang explains. That could help users better understand how their actions—such as drinking a sugary beverage—change their blood sugar and take steps to reduce that effect.

Biolinq’s device consists of an array of microneedles etched onto a silicon wafer using semiconductor manufacturing. (Other glucose sensors’ filaments are inserted with an introducer needle.) Each chip has a small 2-millimeter by 2-millimeter footprint and contains seven independent microneedles, which are coated with membranes through a process similar to electroplating in jewelry making. One challenge the industry has faced is ensuring that microsensors do not break at this small scale. The key engineering insight Biolinq introduced, Yang says, was using semiconductor manufacturing to build the biosensors. Importantly, he says, silicon “is harder than titanium and steel at this scale.”

Miniaturization allows for sensing closer to the surface of the skin, where there is a high level of metabolic activity. That makes the shallow depth ideal for monitoring glucose, as well as other important biomarkers, Yang says. Due to this versatility, combined with the use of a sensor array, the device in development can also monitor lactate, an important indicator of muscle fatigue. With the addition of a third data point, ketones (which are produced when the body burns fat), Biolinq aims to “essentially have a metabolic panel on one chip,” Yang says.

Using an array of sensors also creates redundancy, improving the reliability of the device if one sensor fails or becomes less accurate. Glucose monitors tend to drift over the course of wear, but with multiple sensors, Yang says that drift can be better managed.

One downside to the autonomous display is the drain on battery life, Yang says. The battery life limits the biosensor’s wear time to 5 days in the first-generation device. Biolinq aims to extend that to 10 days of continuous wear in its second generation, which is currently in development, by using a custom chip optimized for low-power consumption rather than off-the-shelf components.

The company has collected nearly 1 million hours of human performance data, along with comparators including commercial glucose monitors and venous blood samples, Yang says. Biolinq aims to gain FDA approval first for use in people with type 2 diabetes not using insulin and later expand to other medical indications.

This article appears in the August 2024 print issue as “Glucose Monitor Takes Page From Chipmaking.”

In the United States alone, more than 100,000 people currently need a lifesaving organ transplant. Instead of waiting for donors, one way to solve this crisis in the future is to assemble replacement organs with bio-printing—3D printing that uses inks containing living cells. Scientists in Israel have found that origami techniques could help fold sensors into bio-printed materials to help determine whether they are behaving safely and properly.

Although bio-printing something as complex as a human organ is still a distant possibility, there are a host of near-term applications for the technique. For example, in drug research, scientists can bio-print living, three-dimensional tissues with which to examine the effects of various compounds.

Ideally, researchers would like to embed sensors within bio-printed items to keep track of how well they are behaving. However, the three-dimensional nature of bio-printed objects makes it difficult to lodge sensors within them in a way that can monitor every part of the structures.

“It will, hopefully in the future, allow us to monitor and assess 3D biostructures before we would like to transplant them.” —Ben Maoz, Tel Aviv University

Now scientists have developed a 3D platform inspired by origami that can help embed sensors in bio-printed objects in precise locations. “It will, hopefully in the future, allow us to monitor and assess 3D biostructures before we would like to transplant them,” says Ben Maoz, a professor of biomedical engineering at Tel Aviv University in Israel.

The new platform is a silicone rubber device that can fold around a bio-printed structure. The prototype holds a commercial array of 3D electrodes to capture electrical signals. It also possesses other electrodes that can measure electrical resistance, which can reveal how permeable cells are to various medications. A custom 3D software model can tailor the design of the origami and all the electrodes so that the sensors can be placed in specific locations in the bio-printed object.

The scientists tested their device on bio-printed clumps of brain cells. The research team also grew a layer of cells onto the origami that mimicked the blood-brain barrier, a cell layer that protects the brain from undesirable substances that the body’s blood might be carrying. By folding this combination of origami and cells onto the bio-printed structures, Maoz and his colleagues were able to monitor neural activity within the brain cells and see how their synthetic blood-brain barrier might interfere with medications intended to treat brain diseases.

Maoz says the new device can incorporate many types of sensors beyond electrodes, such as temperature or acidity sensors. It can also incorporate flowing liquid to supply oxygen and nutrients to cells, the researchers note.

Currently, this device “will mainly be used for research and not for clinical use,” Maoz says. Still, it could “significantly contribute to drug development—assessing drugs that are relevant to the brain.”

The researchers say they can use their origami device with any type of 3D tissue. For example, Maoz says they can use it on bio-printed structures made from patient cells “to help with personalized medicine and drug development.”

The origami platform could also help embed devices that can modify bio-printed objects. For instance, many artificially grown tissues function better if they are placed under the kinds of physical stresses they might normally experience within the body, and the origami platform could integrate gadgets that can exert such mechanical forces on bio-printed structures. “This can assist in accelerating tissue maturation, which might be relevant to clinical applications,” Maoz says.

The scientists detailed their findings in the 26 June issue of Advanced Science.

The US Department of Homeland Security is trialling chemical sensors that detect the first whiff of smoke in the air and alert fire crews while a potential blaze is still smouldering

Autistic children exhibited significantly decreased sympathetic activity and increased relaxation in a sensory-adapted dental environment (SADE) during

Learn about how microneedle sensors are transforming healthcare by enabling real-time, continuous monitoring of biomarkers through wearable, minimally invasive device.

Canon has announced two new mid-tier mirrorless cameras -- the Canon EOS R7 and the Canon EOS R10. These new digital cameras use APS-C sensors. To accompany these two cameras the brand has also launched two new lenses -- RF-S18-45MM F4.5-6.3

Canon has officially unveiled the EOS C80, a digital cinema camera designed for filmmakers looking for versatility, mobility, and advanced video production capabilities. The new camera combines a compact, lightweight design with a powerful 6K full-frame sensor, making it ideal for