What is ACARS?
In a nutshell, Aircraft Communications, Addressing and Reporting System (ACARS) is a digital data link system for the transmission of messages between aircraft and ground stations, using primarily VHF, but also more recently a variety of new technologies (satcom, HDF, cellular, future AoIP). ACARS is central to most aircraft related operational processes.
ACARS messaging generally covers three types of content:
ATC messages include clearances and instructions to aircraft. They are often used to deliver pre-departure, datalink ATIS and enroute Oceanic clearances. AOC and AAC messages are used for communications between an aircraft and its base.
These messages may be of a standard form or as defined by users, but all must meet at least the guidelines of ARINC Standard 618. Any message content is possible, such as:
- Aircraft final load and trim sheets
- Weather/NOTAM information
- Aircraft status, position, ETA, and any course diversions
- Weather observations from aircraft sensors
- Technical performance data (e.g. exceedance or abnormal aircraft system status)
- Catering uplift requirements, special passenger advice, etc.
- Free text messages
ACARS was modelled on the Telex System. The system architecture is based on three main components: aircraft equipment, datalink provider and ground processing systems.
Aircraft equipment
ACARS equipment onboard the aircraft is called management unit (MU) or, in the case of newer versions with more functionality, communications management unit (CMU). These function as a router for all data transmitted or received externally and internally. The ACARS MU/CMU can automatically select the most efficient air-ground transmission method if choice is available.
Ground processing systems and aircraft operators
Ground System provision is the responsibility of either a participating ANSP or aircraft operator. Aircraft operators would often contract out the function to a DSP or to a separate service provider. Messages from aircraft can be pre-configured according to message type, so that they are automatically delivered to the appropriate recipient. Below are some examples of types:
What is it used for?
ACARS data is used for a variety of purposes, such as maintenance analytics, flight operations, safety monitoring, fuel management, ground operation, ops planning, etc. It’s one of the “mission critical” data sources for aviation. This is how the aircraft “talks” to the ground and sends updates about its flight status, various systems and components. And this is how the ground systems can communicate with the aircraft equipment and send updates to the crew.
However, working with the ACARS data is not straightforward. Airlines and operators will have different means of interacting with it, depending on how advanced their internal processes and data systems are. For some, ACARS source data may only reside with the DSP and is made available to the airline via the DSPs dashboard, but not as a downloadable extract or via an API. Others will already have a well-established process for accessing and storing the ACARS data in their own repositories as a raw data dump.
Even though the data standards are defined, there is enough variation in the datasets to get many an expert to pull their hairs out. Data quality, lineage and completeness are a constant challenge. On top of that, ACARS data is not used in isolation either. It is combined with multiple other data sources, mostly manually.
There is no real time analytical capability in the current state of play. You can observe trends and patterns, investigate past events, create static dashboards. But live decisions that would allow proactive management of events as they unfold aren’t possible due to the sheer complexity and cost of integrating ACARS data in a true real time fashion. But that is exactly where the value lies for airlines and their partners.
Imagine, live passenger and baggage information is fed to the ground handlers down at the destination so that the necessary specialty equipment can be made available at the correct gate at the exact time it is needed there so that delays can be avoided. Both the airline (and passengers!) and the ground operator will have a much better turn around experience that saves them time, money and resources.
Planning alone doesn’t address these issues as each day presents different challenges and surprises. The airlines have to be able to deal with the events as they unfold. They insert generic sizable “firebreaks” into schedules to create buffers, which are extremely expensive. Real time data analytics can allow them to reduce these firebreaks and perhaps even shorten turnaround times – planes sitting on the ground do not make money!
This is where IOblend can help
IOblend can fully automate and streamline data collection, processing and management of the ACARS data for the airline. We can connect directly to the DSP via their API or, if not available, request the DSP to provide the data in flat files for a secure download in real time. We can stream data from any source.
Our solution will evaluate the raw ACARS data with respect to data quality attributes: completeness, consistency, accuracy and timeliness – all in memory (cloud or prem). There is no requirement to “land” the data in an intermediate repository (e.g. data lake) for manual processing and enrichment or apply any other data management or transformation toolsets – IOblend does the full ETL end to end and can send the output back to the original systems just as easily (e.g. live updates to the EFB). Persist only what you need.
IOblend pipelines will process the business logic of any complexity (i.e. any integrations are possible). We approach the pipeline design in a modular way and can easily switch on/off various elements, define execution sequences and dependencies, add/remove data sources, and modify transformations. The ACARS data can also be enriched with additional internal and external data, computed fields and/or reference data “in flight”.
Once the business logic is integrated, IOblend does everything else automatically, batch and streaming in the same pipeline. IOblend ensures that only “good” data is used for analysis, meaning the solution will perform a number of processes to get the data into a production-grade state.
Example
Common flight data comes from a variety of operational systems, meaning the ACARS data can be supplemented with additional information in real time to provide a richer analysis. In the case of the airline operational data relating to a flight (other systems such as FMS, AMOS, Flight Ops, Flight Planning, Scheduling) these usually are:
- Flight designation
- Datetime
- Equipment
- Orig/Dest
- Crew ID
These fields drive the design of the primary keys that are then used to combine the data from any of the sources (or backfill missing data fields). IOblend automatically monitors data quality issues in real time. If the DSP fails to provide the data on time or the arrives corrupted, IOblend will highlight the missing records and attempt to automatically reacquire them from the main source. Failure to do that within parameters will trigger another process that will fetch the missing data from a specified secondary/tertiary/etc source (and log the data record origins).
The power of IOblend
Once the data has gone through the pipeline successfully, it can be used by any down route system or process to drive decisions. We connect to anything, ever your favourite Excel.
All data is archived. Nothing is ever lost. Every record has detailed lineage information and can be easily traced for audit purposes. This is especially important for any potential flight incident investigations.
And the best part is, you don’t have to spend months and months designing, coding and maintaining your data pipelines. The pipelines are not “fixed in stone” either. The SMEs themselves can easily develop the pipelines further (and create new ones) as they see fit and adapt to the changing requirements of the business.
IOblend is a drag-and-drop solution that allows you to create very complex data pipelines in a fraction of the time. Welcome to the next generation of data integration tools.
IOblend is a highly scalable platform, able to handle large amounts of data and lots of small data, batch and streaming. It has been developed on top of Apache Spark, the world’s most powerful data framework, and uses a Kappa architecture.
IOblend has been designed as a no-code/low code solution to greatly accelerate pipeline development. All created assets and templates are stored in JSON files and can be easily searched and re-used to further streamline development. Once the solution is running, very little supervision is required due to the high degree of system automation. You manage your ACARS data issues “by exception”.
Step-change your development effort and cost. What took months now takes days. Totally platform-agnostic. The advanced data capabilities you wished you could have in your airline, are now within easy reach.
Curious? Get in touch. Let’s discuss how we can propel you ahead of your competition!
IOblend: Simplifying SCD for Real-Time Analytics
Businesses rely on accurate, up-to-date data to make informed decisions, which is why understanding and managing slowly changing dimensions (SCDs) is crucial.
Metadata Management Made Simple with IOblend
Metadata In today’s data-driven world, information reigns supreme. Businesses and organizations are constantly seeking ways to extract valuable insights from their data to make informed decisions. One often overlooked but essential aspect of this process is metadata. Metadata is the unsung hero that empowers data management, analytics, and decision-making. In this blog, we will delve
Change Data Capture: IOblend’s Seamless Approach
Change Data Capture In the fast-paced world of data management, staying ahead of the curve is not an option, it’s a necessity. Change Data Capture (CDC) is the secret weapon that allows businesses to keep pace with the constant flux of data. In this blog, we will delve into the world of CDC, explore different
Data Schema Management with IOblend
Data Schema Management In today’s data-driven world, managing data effectively is crucial for businesses seeking to gain insights and make informed decisions. Data schema management is a fundamental aspect of this process, ensuring that data is organized, structured, and compatible with various applications and systems. In this blog post, we’ll explore the significance of data
Smarter office management with real-time analytics
Commercial property Welcome to the next issue of our real-time analytics blog. This time we are taking a detour from the aviation analytics to the world of commercial property management. The topic arose from a use case we are working on now at IOblend. It just shows how broad a scope is for real-time data
Better airport operations with real-time analytics
Good and bad Welcome to the next issue of our real-time analytics blog. Now that the summer holiday season is upon us, many of us will be using air travel to get to their destinations of choice. This means, we will be going through the airports. As passengers, we have love-hate relationships with airports. Some