“Productize” Large Language Model LLM Applications

Mainstream media, bloggers, and YouTubers join marketers with opinions and expectations surrounding Augmented (Artificial) Intelligence (AI) especially with the breakout of energy-guzzling Large Language Models (LLMs).

Despite the hype, I have seen a few actual applications of embedding an LLM into software applications. So, the product development engineers among us (I used to be one) must ask themselves—can we turn this into a product?

Well, a company called Tecton announced last month a platform expansion that is said to unlock the full potential of Generative AI in enterprise applications. They say that they empower AI teams to build reliable, high-performing systems by infusing LLMs with comprehensive, real-time contextual data.

Their argument for the limited adoption of LLMs thus far is “the unpredictable nature of LLMs when faced with dynamic business environments. This stems from LLMs’ lack of up-to-date, domain-specific knowledge and real-time contextual awareness. The true value of AI for enterprises lies in leveraging their unique, company-specific data to create customized solutions that are deeply connected to all aspects of their business.”

That is a valid point.

Tecton enhances retrieval-augmented generation (RAG) applications by integrating comprehensive, real-time data from across the enterprise. This approach augments the retrieved candidates with up-to-date, contextual information, enabling the LLM to make more informed decisions. The outcome is hyper-personalized, context-aware AI applications capable of split-second accuracy in dynamic environments. For instance, an e-commerce AI could instantly consider a customer’s browsing behavior, inventory levels, and current promotions to retrieve the most relevant product candidates, significantly improving recommendation quality and conversion rates.

Check out the details at their website.

PTC Announces Strategic Collaboration Agreement with AWS

Amazon stumbled into quite a business when it developed Web Services. Of course, Microsoft and Google entered the market proving it’s a real market. AWS has been gaining ground in the industrial software space. This news comes from PTC announcing that its Onshape business has announced entry into a Strategic Collaboration Agreement with Amazon Web Services (AWS).

The objective is said to accelerate the growth of its Onshape cloud-native computer-aided design (CAD) and product data management (PDM) solution. This collaboration will focus on advancing Onshape product enhancements, customer adoption programs, and artificial intelligence (AI) initiatives, all of which are aimed at helping product designers and engineers create new, high-quality products faster and more efficiently.

  • The Onshape Discovery Program allows qualified users to try Onshape Professional at no cost for up to six months.
  • Onshape AI Advisor will allow users to design products faster by cataloguing the Onshape resource library of text-based documentation and videos and answering questions or making recommendations during the design process. While designing, users will be able to type a question in simple, conversational language and the Onshape AI Advisor will respond with an answer or recommendation based on the resource library and provide links to additional information. The Onshape AI Advisor will run on Amazon Bedrock and is expected to be released by the end of 2024.
  • CAD and PDM Conversion Tools will allow the expansion of the capabilities of Onshape intelligent data migration toolsets. These toolsets reduce the complexity of switching systems by preserving the parametric features and sketch information of CAD models during translation.
  • Onshape Government option will deliver this security footprint to comply with The International Traffic in Arms Regulations (ITAR) and The Federal Risk and Authorization Management Program (FedRAMP) requirements.

Inductive Automation Ignition Community Conference

I think I’ve been to all twelve Inductive Automation Ignition Community Conferences in Folsom, CA. It’s possible I missed one. They are always enjoyable. It’s truly a community where people share ideas and show success stories. The partner ecosystem for Ignition consists of strong, smaller, innovative companies and creative systems integrators.

To quote from the press release, Now in its twelfth year, the Ignition Community Conference (ICC) brings together industrial professionals from around the world to network, collaborate, and learn more about Ignition — an industrial automation software platform for SCADA, HMI, IIoT, MES, and more — and the ecosystem of technology solutions that work with it.

Highlighting the first day, executives Colby Clegg and Carl Gould previewed the release of Ignition 8.3. Yes, the last version was 8.1. This is a significant update even further integrating with IT technology. Founder Steve Hechtman explained to me when we first met 20 years ago how Ignition was built from the ground up to be IT friendly—unique for a SCADA application. They continue the tradition.

The update, scheduled for January 2025 release, features a redesigned Gateway user interface said to be faster, more intuitive, and easier to navigate. Upgrades to the Ignition Perspective Module include integrated drawing tools, a flexible form generation component, and the ability to design applications for offline use.

Another upcoming feature called Event Streams will allow users to map event data from sources to handlers, giving them new ways to push, transform, filter, and batch data. Also included are a new, public historian API and a new Power Historian that’s embedded in the Ignition platform, along with many other new features, and will be actively supported for five years after its release.

System integrators who leverage the Ignition platform to create exceptionally innovative and successful projects, are featured with Firebrand Awards. This year’s awards featured these applications.

NeoMatrix Inc., which helped Lucid Motors implement a real-time factory information system that provides data on manufacturing performance to enable data-driven decisions, optimize processes, and improve overall operational performance.

Deloitte, which implemented a modern SCADA/MES system, realizing Goodman Fielder’s initiative to enhance production efficiency and replace manual processes at their three largest bakeries.

IDOM, which implemented a real-time automation orchestrator for the entire production process at the pharmaceutical company Cinfa, including a Unified Namespace that allows applications to exchange information in a decoupled architecture.

Saint-Gobain CertainTeed, which deployed the Vision Module-based FaCTory+ MES solution, which pulls in production orders from SAP, tracks 24-hour performance, compares current and previous production runs, and more.

Fermi National Accelerator Laboratory, which created a library of standardized objects with heavy use of User Defined Types (UDTs), allowing it to easily monitor and control a large-scale experiment analyzing the properties of neutrinos.

Madkour Group, which built a system providing real-time data from remote locations and reporting and analytic tools for the National Project for Developing the New Valley in Toshka, which aims to reclaim vast desert areas as part of Egypt’s overall plan to cultivate three million acres in total.

All of the winners’ and finalists’ project submissions, including videos and written case studies, can be viewed in the online ICC Discover Gallery

The event sold out once again packing about 900 people into the Harris Center in Folsom. Inductive Automation made the difficult decision to leave their home of the past 12 years and move to the SAFE Credit Union Convention Center in Sacramento, California. Located in downtown Sacramento, about 30 miles from Folsom, the SAFE Credit Union Convention Center is a fully remodeled, state-of-the-art venue with over 240,000 square feet of space, and within walking distance of many hotels, restaurants, and entertainment options.

During the Closing Keynote session on September 19, Project Manager Nick Barfuss made a surprise announcement that Inductive Automation will soon launch a unified, browser-based interface for end users, integrators, and IA staff and distributors.

Known as Inductive Automation Workspaces and launching in 2025, the new interface will streamline the Ignition sales process with self-service or assisted-service modes, and empower organizations to access and manage their licenses, support plans, roles, and organizational structure.

Workspaces will launch with features for creating organizational units; creating and sharing estimates, quotes, and orders; managing licenses and support plans; making purchases in local currency; and more.

During the Closing Keynote session, Co-Directors of Support Services James Hunt and Marcus Bellamy announced that Inductive Automation will be extending its software support hours by nearly 50 percent in Q1 of 2025. The two leaders explained that the company is adding more support engineers at its offices in the US and Australia, which will expand the support hours from 6 AM to 5 PM PST to 6 AM to 11 PM PST.

During the Main Keynote session, Chief Technology Evangelist Travis Cox discussed the tenth anniversary of Inductive University, the free online industrial automation training platform that the company launched during ICC 2014.

Cox said that Inductive University (IU) has become one of the company’s most popular training resources and has seen fantastic growth. Since launching a decade ago, IU has had over 10 million video views, almost 8 million tests (known as “challenges”) have been taken, over 100,000 user accounts have been created, and 30,000 Ignition credentials have been earned. Cox also said that these IU numbers represent hundreds of thousands of people who have gained new knowledge that helps them turn their ideas into reality.

During the Closing Keynote session, Co-Directors of Support Services James Hunt and Marcus Bellamy gave a glimpse of what lies ahead for IU, saying that their team will be adding over 70 new videos to IU in 2025, as well as adding learning paths that are specific to skill level.

Automated Schedule Intelligence Solution

MachineMetrics positions itself in the analytics space translating from operations to ERP. It has released a scheduling solution called Production Schedule Intelligence touting scheduling accuracy, work-in-process optimization, and on-time delivery.

This solution integrates real-time data and predictive analytics into operations connecting directly to both ERP and machines.

Key Features and Benefits

  • Dynamic Schedule Optimization: Continuously assesses and adjusts production schedules based on real-time operational data, dynamically adapting the schedule to address machine downtimes and other production interruptions.
  • Real-Time Adjustments: Visualizes your scheduled OTD targets and predicts completion dates in real-time.
  • Interactive Production Order Management: Users can easily edit and re-sequence production orders through an intuitive drag-and-drop interface, with immediate feedback on schedule health.
  • Real-Time Impact Analysis: The system flags potential delays and adjusts work-in-process calculations dynamically, enabling proactive schedule management and empowering plant managers to make smart decisions based on real data.
  • ERP Data Utilization: Integrates seamlessly with ERP systems to use planned start dates and cycle times as reliable baselines for adjustments.

Advanced Vehicle Assemblies Utilizes Plex for Increased Production Visibility & Control

 I seldom do case studies here. I don’t have time to do a proper set of interviews that would emphasize team rather than product. This one came from Rockwell Automation’s company Plex. Gathering appropriate data and displaying it in ways that boost decision making constitutes a recurring problem for operations management. This story details establishing real-time reporting, insight into inventory tracking, and visibility across production.

The client company, Advanced Vehicle Assemblies, LLC (AVA) is known for its unique, complementary manufacturing processes that enable the production of complex metal assemblies. Founded in 2021, AVA has expanded significantly and now ships approximately 52.2 million parts annually.

The problem statement from AVA CIO Rob Arrowsmith: data was not easily accessible, and functions difficult to learn. 

The result: real-time data is accessible, and online learning resources are abundant and easy to follow.

[Note: what follows was written by Plex marketing. I did not edit out all the adjectives and adverbs. It is a good story of actually implementing a complex software application in a short amount of time.]

AVA split from its former sister company in June 2020 and this transition kicked off an urgent search for a new ERP system. They were temporarily covered under a shared service agreement from their previous affiliation, but the end date was nearing. As a result, the company looked for an ERP solution that minimized hardware maintenance — a stark contrast to their previous experience — and could be implemented within their tight timeline.

Alongside the frequent maintenance required by the old ERP system, AVA also faced the fact that the old system did not include Manufacturing Execution System (MES) integration. The absence of real-time production reporting and inventory tracking led to reliance on manual processes, causing significant delays and a lack of trust in the collected data. As AVA aimed for rapid independence and organizational rebuilding following the split, the selection of a new ERP system became a critical aspect of their strategic focus.

As it navigated the landscape of ERP options during the summer of 2020, AVA conducted surveys, evaluations, and demonstrations to help identify their top priorities with the help of user feedback. Despite the tight timeframe, the culmination of this rigorous process led them to select Plex as their new ERP system in late 2020. This choice marked a pivotal step for Advanced Vehicle Assemblies, LLC as they embraced a new ERP system that promised to streamline operations, enhance efficiency, and support their journey towards becoming a thriving, independent enterprise. 

Embarking on their ERP system revamp journey, AVA utilized the Milan, Michigan facility as their first Plex implementation site in December 2020. This location shared the outdated ERP system with AVA’s sister company, adding an extra layer of complexity to the transition. Knowing time was of the essence, Milan aimed to go live on Plex within 60 days.

To ensure a successful transition, AVA enlisted the support of Plex implementation services, who assigned a project manager to the Milan site. This project manager brought a deep understanding of the project’s parameters and the urgency of a rapid go-live timeframe. To bolster their efforts, the Plex team tapped on outside consultants to assist with the critical data cleansing phase as it was loaded into Plex. Employee training sessions and workshops were also prioritized, acknowledging the importance of preparing users for the impending changes.

As the go-live date loomed, an impressive collaboration unfolded, with up to seven Plex team members present at the Milan location during each shift. This emphasis on teamwork from all sides underscored the collective commitment to a successful implementation. Despite the challenge of a 60-day timeline, the Milan site successfully implemented Plex within the desired timeframe. Employees showcased resilience and adaptability as they mastered the main Plex functions, navigating the natural learning curve that comes with migrating to a new manufacturing solution.

The Plex implementation brought about a transformative wave of improvements for AVA, revolutionizing their operational landscape. One of the most notable enhancements was the establishment of real-time production reporting and inventory tracking. The newfound ability to access data in real time instilled a heightened sense of awareness of inventory for AVA, enabling employees to address issues promptly, fostering agility in their responses and elevating overall operational efficiency.

Furthermore, the implementation of Plex significantly augmented visibility across production. With operators more engaged and proactive on the shop floor, AVA witnessed quicker problem resolution. The benefits of Plex extended beyond the shop floor as it empowered AVA to successfully grow its business while maintaining a lean operational structure, minimizing the need for additional personnel to manage the Plex ERP system. Additionally, key Performance Indicators (KPIs) became more visible and dynamic, seamlessly integrating into Plex as native components rather than being extracted from external Excel sheets.

Plex also eliminated the necessity for financial consolidation software, streamlining processes and making contextual data easily available. The intuitiveness of the Plex system unlocked this accessibility, making it easy for users to navigate and find the information they need. The cloud-based nature of Plex, coupled with its highly configurable background settings, provided a foundation of flexibility that empowered AVA to continue to test and implement improvements. This adaptability positioned Plex as a transformative tool that not only met AVA’s original expectations for their ERP system but exceeds them into the present and future.

After the Plex implementation, Advanced Vehicle Assemblies, LLC has gone on a revolutionary journey marked by significant improvements across various facets of their operations. The shift from an outdated ERP system to Plex resulted not only in material improvements but also newfound capabilities and efficiencies. Perspectives have also evolved across departments, emphasizing the importance of collaboration and data utilization.

For AVA, the most significant achievement with Plex has been the ability to attain complete independence. Upon completion of the implementation, internal surveys affirmed the success of Plex as it earned high marks for reliability, speed, and ease of use. The adoption and integration of the software extends beyond that of the Milan, Michigan location, with AVA employees able to take on the remaining Plex implementations internally with little to no Plex support required on site.

As AVA looks towards the future, the success of the Plex implementation stands as a testament to the company’s resilience and adaptability, setting the stage for continued growth and operational excellence for years to come.

Ignition Latest Release from Inductive Automation

The last software update of Ignition from Inductive Automation before the Ignition Community Conference coming up in September offers several interesting enhancements.

  • Gateway Trial Status Indicator—a persistent indicator in the designer to keep you informed about the status of your Gateway’s trial mode.
  • Mitsubishi Driver Configurable Settings—you can now configure MELSEC Access Route settings in the Mitsubishi Driver. 
  • New Response Mode For OAuth2 & OIDC—a more secure way to receive authorization responses with an additional supported response type for both OAuth2 and OIDC identity providers. Now, you can accept the response_mode of form_post from both of these identity providers through your web browser.
  • Development License Banner—Now, when an Ignition development license is active, there will be a banner displayed on Gateway web interface pages to alert you to that.
  • EAM & Redundancy—the -Dignition.redundancy.restoreFileTTL Java additional parameter, so you can control the TTL of restore files created by backup/restore operations (including redundancy) on disk. Now, you have the ability to specify a minute value, in order to accommodate Gateways that exceed that timespan in their shutdown/startup cycle.
  • Gateway Performance Monitor Logger—added a logger to Gateway.PerformanceMonitor, which the IA Support Team will be able to use to speed up your troubleshooting process if your CPU monitoring visuals start behaving strangely. Support will be able to help you turn this logger to TRACE and see exactly what your elapsed, systemTime, and lastSystemTime variables look like.

Follow this blog

Get a weekly email of all new posts.