Pages

Saturday, May 13, 2023

Garbage In, Garbage Out

Here’s another Air Force issue that is highly relevant to the Navy and the military, in general.
 
Boeing’s T-7A Red Hawk is years behind schedule.  This is not a highly complex, F-22/35 type stealth combat aircraft;  it’s a simple trainer intended to replace the Air Force’s T-38 Talon.  As a Drive website article notes, the T-7A was going to revolutionize aircraft design and construction by using computers and digital models. 
Advertised by the Air Force and Boeing as the service’s first "digitally designed and engineered" aircraft, T-7A was lauded as a poster child for developmental speed.[1]
 
The Red Hawk was expected to begin a new era in rapid design and engineering with iterative development carried out in the virtual world via modeling and simulation without having to bend metal or conduct extensive real-world testing. Systems integration would be accelerated and the time from the first flight to production significantly compressed.
 
It hasn’t worked out that way.[1]

Foolishly, we assign an aura of infallibility, bordering on a religious faith, to everything digital.  The reality, however, is that everything in the digital world    everything  … let me repeat that    everything   is governed by the ancient computer programming adage, GIGO which stands for,
 
Garbage In, Garbage Out
 
It doesn’t matter how brilliant your program is, if you feed it garbage input, you get garbage output. 
“A funny thing happens when you move out of digits to reality,” Teal Group analyst J.J. Gertler said.  “Digital engineering has the capability to rapidly iterate but it’s only as good as the information you put into it. It may also help you get to a wrong answer faster which you then have to back out of.”[1][emphasis added]
 
There you have it.  GIGO. 
“Digital engineering isn’t going to make issues go away,” he [Dr. Will Roper, former assistant secretary of the Air Force for Acquisition, Technology and Logistics] noted. “It’s going to create a new issue which is – do you trust the underlying models and simulation upon which your performance predictions are based?”[1][emphasis added]
 
When hand held calculators were introduced, teachers noted that they all too often helped students get the wrong answer faster.  The calculator was electronically correct but the students were too ignorant to input the correct data.  GIGO.  The same phenomenon is prevalent in industry. 
 
Closely related, students lost the ability to recognize obvious incorrect results caused by mistaken inputs (accidentally pushed the wrong button) because they lost the ability to quickly estimate expected results and be able to recognize that an answer was patently incorrect.  I can instantly estimate 18x20 by rounding it to 20x20=400.  Therefore, I can recognize that an answer of 3600 is an order of magnitude off.  Students no longer have the ability to do that and cannot recognize obvious errors - the calculator said it so it must be right.
 
We’ve become so caught up in our blind worship of technology that we’ve completely ignored the constant presence of the GIGO phenomenon.  Digital results are accorded unquestioned faith.  Whether it’s artificial intelligence, computer aided design, pilot or ship driver training via simulation, or command and control networks, they’re all plagued by the constant presence of garbage input. 
 
Every Navy and Air Force design and acquisition program for the last two decades has claimed to be computer designed and computer aided and yet none have been what anyone would judge a success.
 
We had far more successful ship and aircraft design results from people using paper, pencil, and a slide rule then we do now using computers.  Common sense is screaming lessons at us but we’re too busy worshipping at the altar of technology to hear them.
 
How’s that simple, straightforward Air Force KC-46 tanker coming along?  It’s been well over a decade and still counting! 
 
Remember the Ford?  Computer modeled and computer designed?  How’d that turn out?
 
The F-35’s ALIS logistics, maintenance, and mission planning program was going to solve all our problems and yet it’s been abandoned and nothing has yet taken its place.
 
And so on.
 
The problem is that the people inputting the information are all too often incompetent idiots who can’t even rattle off their multiplication tables without consulting a calculator.  Have you ever tried to get change from a cashier who hasn’t got access to the register’s computer output?  They can’t calculate simple change in their head.  Why would we expect such people to be able to recognize garbage input and avoid it?  They can’t.  We’ve crippled ourselves, as a society, by allowing calculators in schools.  But, I digress …
 
We now have military leaders who are inputting idiotic data into wargames, computer models, and simulations and are unable to even recognize the idiotic results.
 
This isn’t just about arithmetic errors.  In the military, the idiotic inputs are things such as
 
  • Assuming the enemy won’t respond in any harmful way to us.
  • Assuming everything we do will work and nothing the enemy does will work.
  • Assuming that we have capabilities the enemy doesn’t.
  • Assuming our systems will work flawlessly.  Does any wargame factor in, oh, say, Ford EMALS breakdowns?  We have hard data but we’re hand waving away the reality.
  • Assuming our surveillance assets will be allowed to conduct their missions without hindrance.
  • Assuming we’ll have no problem working around the enemy’s electronic warfare even though any attempt at introducing even a modicum of EW into a real exercise has ended in the complete collapse of the exercise.
  • Assuming our networks will work flawlessly even though we’re being successfully attacked and penetrated by enemy cyber forces on a daily basis.
 
This is the kind of idiotic, garbage inputs that are producing garbage outputs.  Unfortunately, we’re too stupid to recognize the garbage nature of either our inputs or outputs and so we blindly follow our technology down ever more incorrect paths.
 
 
Garbage In, Garbage Out
 
 
___________________________
 
[1]The Drive website, “T-7A Delays Compound Pilot Shortage, Expose Digital Engineering Pitfalls”, Jan Tegler, 12-May-2023,
https://www.thedrive.com/the-war-zone/t-7a-delays-compound-pilot-shortage-expose-digital-engineering-pitfalls
 

19 comments:

  1. You are correct ComNavOps. Back in the old days with a slide rule, you had to KNOW where to place the decimal point. I had a physics prof in the mid 1970s when only half the students had calculators who would lay traps for them on tests. They would start frantically punching numbers in. The rest of us would write out the equation with the numbers, discovering the numerators are half or twice the denominators. Didn't even need a slide rule - you could do it in your head.

    ReplyDelete
    Replies
    1. I know of an engineering lecturer who set a problem where every relevant number was 12. The answer turned out to be
      12x12x12^2/(12^3). Equals 12.

      Delete
    2. Calculators should be banned from schools.

      Delete
  2. Read about the delays the Airforce has experienced with the T7. Not only has there been a software issue but an ejection seat issue. " But the T-7A's significant delay means the Air Force must continue to rely on the aging T-38C Talon, a training jet that has been in its fleet since the 1960s and has seen a slew of recent accidents and issues."
    When thinking about these accidents with the T28 one wonders about our military's sustainment and safety inspection of aircraft in general.
    https://www.military.com/daily-news/2023/04/25/air-force-faces-2-year-delay-new-t-7-training-jets-old-aircraft-continue-have-mishaps.html

    ReplyDelete
  3. It's showtime for the USS Ford! It left Norfolk a week ago for a regular six-month deployment. No news yet. Can it survive a six-month deployment? If not, what next?

    ReplyDelete
    Replies
    1. Oh, I guarantee that the Navy will describe it as the most successful deployment in history. Unfortunately, with DOT&E no longer providing any useful information, it will be a challenge to get the real information.

      Delete
    2. With all of the reported problems with the USS Ford one wonders if the Navy should SLEP some of the earlier Nimitz Class until the Ford is deemed fit as a warship. Hopefully the problems with the first of glass will not be repeated in the 2 carriers being produced !

      Delete
    3. Also would USS George W Bush be of lower cost in today's dollars than USS Ford? ( steam catapults, no EMALS, etc.)

      Delete
    4. Anonymous

      It's not two, but three more Fords, with the same failed systems. They haven't fixed the problems because they can't! The USS Kennedy is ready to be commissioned, and two more are halfway complete because the Navy decided to accelerate procurement. After that was approved, the Navy announced no more Ford class carriers are needed and a new class is being designed. So the Navy may end up with four useless carriers that cost $14 billion each.

      Delete
  4. Your point about garbage in, garbage out is correct. It is also true that Boeing has completely gutted its once successful engineering culture.

    Some of the most aggressive users of advanced modeling are SpaceX and Tesla. They’ve gotten pretty good at it because they use the software to test a wide variety of designs then use hardware~rich iterative testing to work out the bugs and verify the models. SpaceX famously has hardware-in-the-loop software updates where any software update is tested on a hardware twin of the rocket’s avionics in their lab. Falcon 9 and Dragon have been wildly successful while Boeing’s human capsule is years behind schedule with problem after problem. Boeing didn’t even bother to test all its software together before the first demo flight that then failed because of software bugs.

    Software modeling is an incredible tool for the few that can successfully wield it. The Air Force and Navy should emulate NASA in not allowing Boeing to be the only prime contractor for any program important to their success.

    ReplyDelete
  5. This is not an isolated event. Just look past 20 years, you can hardly name one successful major weapon development.

    ReplyDelete
    Replies
    1. "Just look past 20 years, you can hardly name one successful major weapon development." It sounds like a cultural problem, as in 'Western Civilisation is decaying rapidly'.

      Delete
  6. I'm confident the will survive its six-month deployment. (Well, presuming it doesn't run into anything, or get into a fight with some batteries and cardboard boxes.) I'm skeptical that it will be able to reliably launch and recover aircraft. Not that the Navy will consider that a problem. Who needs a CAP anyway? It just stresses the aircraft and burns fuel. If only the Navy could have figured out how to not fly aircraft from their carriers decades earlier, just think of how much money they could have saved!

    ReplyDelete
  7. Anecdote:
    While in the Navy Command Center in the Pentagon, I had a boss who consistently rejected several of my memos because they couldn't be right since I was a relatively junior officer (LCDR). I finally resorted to printing the memos on computer paper---all were accepted, because the computer produced them!

    ReplyDelete
  8. From the outside looking in, the problem seems to be in the procurement process.

    My understanding is that during WW2 and prior, there was a contract issued which included something like a 6% profit above the expected expenses.

    Now, probably because of the black hole of R&D included, there seems to be no penalty for cost overruns. There is no downside for slow delivery.

    In fact it's the opposite. Cost overruns are just the equivalent of 'value added' for the defense contractor.
    Slow development and delivery is simply extended guaranteed employment for the contractor.

    In the 1920's a shipyard went out of business because it had underbid on a navy cruiser contract.
    Now that would be rewarded by the Dept of Defense.

    Lutefisk

    ReplyDelete
    Replies
    1. @Lute. Have to agree, at the moment, failure is rewarded more than success. I can't think of any program inside DoD that's more or less on time and budget, is there any reward for that? Probably not so lot better to take forever and just run up the tab! Unless your Boeing and you just lose money somehow LOL!

      Delete
  9. A while ago, I worked at a Univ Research Center. Made it explicit in the proposal what the Client could expect to learn, what they could not, what and how we were going to do, and how much it would cost. Best comment my (big) boss passed on from one of them "You spend our money like it was your own" (i.e., frugally).

    ReplyDelete
  10. USS Gerald R. Ford Holds Change of Command

    https://www.dvidshub.net/news/443268/uss-gerald-r-ford-holds-change-command

    Is this normal or is something odd here? Yes, he had been CO for over two years, but he did the work up with the crew and wing and deployed, then 20 days into a six-month deployment you change the Ford's CO? Is this normal Navy dysfunction or did the CO upset someone?

    ReplyDelete

Comments will be moderated for posts older than 7 days in order to reduce spam.