X-ray reverse-engineering a hybrid module from 1960s Apollo test equipment

In this blog post, I reverse-engineer a hybrid module that was used for ground-testing of equipment from the Apollo space program. But first, some background. During the Apollo missions to the Moon, NASA could send digital messages to the spacecraft from the ground. These data messages could perform specific tasks: control spacecraft equipment by activating relays, send commands directly to the Apollo Guidance Computer, or even set the spacecraft's clock. Onboard the Command Module, these messages were decoded by the Up-Data Link, a drab bluish box (below) mounted in the equipment bay.

The Up-Data Link (UDL) was installed on the Apollo Command Module.

The Up-Data Link (UDL) was installed on the Apollo Command Module.

To ensure a successful mission, all the systems of Apollo were thoroughly tested on the ground before flight. The Up-Data Link was tested with the box below, labeled "Up-Data Link Confidence Test Set". Our friend Marcel obtained this box at a scrapyard, so we set out to make it work, but unfortunately it had no documentation and a few missing components. After reverse-engineering its complex circuitry and performing some repairs, we figured out how it works: The test box read a command from paper tape, encoded it for radio transmission using phase-shift keying, fed the signal into the up-data link box, and then verified that the up-data link box took the proper action. The transmitted message was shown on the display, while the red and green status lights indicated if the operation was decoded successfully. Thus, the test box provided an automated system for exercising the functions of the up-data link.

The up-data test box is a heavy rack-mounted box full of circuitry. The wiring on top is for our reverse-engineering, plugged into the box's numerous test points.

The up-data test box is a heavy rack-mounted box full of circuitry. The wiring on top is for our reverse-engineering, plugged into the box's numerous test points.

The construction of the test box was very unusual from a modern perspective. The box was constructed from 25 printed-circuit boards, with the boards connected by a tangled backplane of point-to-point wiring. Each board held up to 18 gray rectangular modules, blocks that look a bit like relays but contain electronic circuitry. These modules were built by Motorola and had labels that indicated the type of module; the photo below shows some of these compact modules, each 1.5" long. On the underside of the module, 13 pins in two unequal rows were plugged into a socket on the circuit board.

Some of the Motorola modules: 2/2G&2/1G, LD, 2P/3G, and LP FF. The printing for the part numbers smudges very easily.

Some of the Motorola modules: 2/2G&2/1G, LD, 2P/3G, and LP FF. The printing for the part numbers smudges very easily.

Why would a complex electronic box be built from modules instead of integrated circuits? The invention of the integrated circuit in 1958 led to an electronic revolution, but in the mid-1960s integrated circuits were still expensive and rare. An alternative was small hybrid modules that functioned as building blocks: logic gates, flip flops, op-amps, and other circuits. Instead of a silicon chip, these hybrid modules contained discrete transistors, resistors, capacitors, and other components.

I could find no documentation on these Motorola modules, or even a mention of them, despite my best efforts with Google and Bitsavers. However, the modules could be easily removed from the sockets for experimentation, with the unexpected convenience that the 0.200" pin spacing is compatible with modern solderless breadboards. For most of the modules, I could determine their function by probing them with test signals, in combination with examining their surrounding circuitry, which showed standardized +6 and -6 volt power supply connections. The modules had simple logic functions hinted at by the labels: for instance, the "LP FF" was a (low-power? low-performance?) flip flop while "2/2G & 2/1G" indicated a module with two 2-input NAND gates and two 1-input gates (i.e. inverters).

However, some of the box's circuitry was analog, and these modules were harder to decipher, especially the circuitry that encoded the binary output as a phase-shift keying (PSK) signal. Digital data could not be transmitted directly to the spacecraft, but needed to be encoded as an analog waveform for radio transmission. In particular, the digital up-data message was encoded using phase-shift keying (PSK), flipping a 2-kilohertz sine wave to indicate a 0 or a 1. In other words, a phase of 0° indicated a 1 bit while a phase of 180° represented a 0 bit.1

This vintage diagram shows how a binary signal is encoded as an audio signal using phase-shift keying (PSK). "kc" indicataes kilocycles; the unit "Hertz" was made the standard in 1960 but "cycles" remained for years.

This vintage diagram shows how a binary signal is encoded as an audio signal using phase-shift keying (PSK). "kc" indicataes kilocycles; the unit "Hertz" was made the standard in 1960 but "cycles" remained for years.

The up-data test box required two boards to perform the PSK modulation and inconveniently a couple of key components (probably high-quality tunable inductors) had been removed when the box was scrapped, making it hard to understand the circuitry. One module sat at the heart of the PSK circuitry, helping to shape the square-wave signals into smooth sine waves. This module had the label "-3.9V" and sure enough it produced -3.9 volts, but it contained additional mysterious circuits (and unexpectedly the -3.9 volt output wasn't used). The mystery circuits appeared to be resistor-capacitor networks. CuriousMarc has a vintage HP resistor-inductor-capacitor meter, capable of measuring series or parallel circuits, but it clicked and flashed its lights unsuccessfully before giving up on the -3.9V module.

The "=3.9V" module is in the center of this board. The module has been removed from the socket to make its label visible. The large black rectangle is a transformer. Selecting a particular winding provides the phase inversion for PSK.

The "=3.9V" module is in the center of this board. The module has been removed from the socket to make its label visible. The large black rectangle is a transformer. Selecting a particular winding provides the phase inversion for PSK.

We figured that X-rays might reveal the secrets of the module and John McMaster kindly agreed to X-ray the module. The photo below gives an X-ray view of the module from the side, showing the internal components and the pins at the bottom. The module's plastic packaging is visible as a ghostly gray, not blocking X-rays to the extent of the metal wiring. Two printed-circuit boards are visible, one at the top and one at the bottom, with components mounted vertically, a technique known as cordwood construction. This construction was used in the 1960s when dense packing of components was required, with the cylindrical components stacked together like wooden logs.

X-ray image of the module from the side. Composite of three images.

X-ray image of the module from the side. Composite of three images.

Some of the components have distinctive appearances in their X-ray images. The carbon composition resistors are gray cylinders with leads.2 The Zener diode's internal construction is visible as a ghostly S-shaped spring, as shown below. The opaque cylinders are capacitors, probably with rolled plates blocking the X-rays. The U-shaped rectangular component near the left is a capacitor, probably a metalized film capacitor. The diagram below compares X-ray images and physical cross-sections of Zener diodes and resistors.

X-ray images and cross-sections of Zener diodes and carbon composition resistors. The cross-section components are similar but not identical to the X-ray components. Cross-section photos copyright Eric Schlaepfer and Windell Oskay.

X-ray images and cross-sections of Zener diodes and carbon composition resistors. The cross-section components are similar but not identical to the X-ray components. Cross-section photos copyright Eric Schlaepfer and Windell Oskay.

An X-ray image from the bottom of the module provides a different perspective. The pins are at the top and bottom of the image, slightly angled with circles at each end where they are connected to the circuit boards. The cylindrical components show up as circles: larger circles for the capacitors, and smaller circles for the resistors. The important feature of this viewpoint is that it shows the PCB connections between the components, although there is inconvenient ambiguity about whether a trace is on the top or the bottom circuit board. The image also reveals mysterious text such as J65 and H66. These are probably labels etched into the copper of the circuit boards for identification.

X-ray image of the module from the bottom. Composite of three images.

X-ray image of the module from the bottom. Composite of three images.

A tilted view of the module helps to resolve the ambiguity, separating traces on the top circuit board from traces on the bottom circuit board. It still took me some pondering to sort out the internal structure. (A CT scan would figure out the 3-D representation automatically, but this was a regular 2-D X-ray machine.)

Tilted X-ray image of the module.

Tilted X-ray image of the module.

The 3-D model below shows my interpretation of the X-rays images. The module's 13 pins are connected to both the top and bottom circuit boards, as are the cylindrical components. (The square capacitor is an exception, with both connections to the top board.) The traces on the circuit boards create the circuit.

A 3-D representation of the interior of the module, created with OpenSCAD. I don't guarantee that it's 100% accurate.

A 3-D representation of the interior of the module, created with OpenSCAD. I don't guarantee that it's 100% accurate.

I created the schematic diagram below to match the X-ray images. Prior to the X-rays, we had figured out most of the schematic by probing the module, but there were a few surprises. The most important discovery was the series-parallel structure of R1, C1, and C2, where we had only expected a single resistor and capacitor.3 (This complex topology is why CuriousMarc's Hewlett-Packard device was unable to determine the capacitance.) Another important X-ray observation was that the construction of C2 was different from the other capacitors, so it probably had a very different capacitance, which turned out to be nanofarads vs microfarads. Once I understood the circuit topology, I could probe the circuit with signals of different frequencies and determine the approximate component values.

A schematic diagram of the module. Component values are from curve-fitting to oscilloscope traces, so they're probably off by at least 10%.

A schematic diagram of the module. Component values are from curve-fitting to oscilloscope traces, so they're probably off by at least 10%.

We're still developing a rigorous explanation of the module's function in the box. To summarize, the module helps convert 1-kilohertz and 2-kilohertz square waves into sine waves to produce the PSK output. Through trial and error, CuriousMarc determined the right inductors to make the circuit resonate at these frequencies. The R-C circuits in the module pass a small "kick" when the square wave switches, enough to keep the resonance going, but not so big that it distorts the sine wave. Strangely, the eponymous -3.9V Zener reference isn't used.

Conclusion

The X-ray images cleared up several mysteries about the modules. First, we learned that the modules used cordwood construction, rather than a single PCB or point-to-point wiring. Next, the X-rays revealed a couple of unexpected components and helped us figure out the circuit technology. Finally, we could see the internal structure of some components, which we weren't expecting to be visible. The main lesson I learned for future X-rays is to take shots from multiple angles to help resolve 3-D ambiguities.

I'm curious about whether these Motorola modules were part of a comprehensive prototyping product. We've looked at a lot of Apollo hardware and have never seen these modules elsewhere. I haven't been able to find any reference to them. The construction seems like a flexible system designed for prototyping; the modules, the circuit boards, the plastic frames to hold them, the connectors, and the chassis all seem designed to work together. It gives the impression of a well-thought-out system for building electronic hardware in the 1960s, but apparently it vanished without a trace (except for this box). If any readers know more about these modules, please let me know.

As for the -3.9V module specifically, what was the original purpose of this module and why did the designers use it in the up-data test box? I can understand selling logic gates and flip flops as generic components, but this module seems much too specialized to be a standard product. On the other hand, a custom module would just require new PCBs—a small investment compared to designing a new integrated circuit—so producing custom modules seems very practical. But that raises the question of why they would custom-design a -3.9 volt module for the up-data test box and then not use its Zener circuit. My current hypothesis is that the -3.9 volt module was designed for an earlier revision of the up-data test box but that functionality turned out to be not used.

If you want more background on the Up-data Test Box, I have some Twitter threads: power-up, modules, paper tape reader, and clock circuit. Also see CuriousMarc's video on the box:

We plan to connect the up-data test box to the up-data link box and see if they work together. Then, we hope to create the full signal path: the up-data test box to a transmitter, and then the S-band transponder to the up-data link box, so we can transmit messages via radio (albeit over a few feet rather than to the Moon). I announce my latest blog posts on Twitter, so follow me @kenshirriff for updates. I also have an RSS feed. Many thanks to John McMaster for X-raying the module and to Marcel for providing the up-data test box. Cross-section photos courtesy of Windell Oskay and Eric Schlaepfer, from the upcoming book Open Circuits, which you should check out.

Notes and references

  1. Phase-shift keying was just the beginning of the signal's processing on the way to the spacecraft. Next, the PSK signal was modulated on a 70-kilohertz subcarrier (so it wouldn't conflict with the voice transmission), and finally phase-modulated at exactly 2106.40625 megahertz for transmission from a massive ground antenna to the distant spacecraft. 

  2. In the X-rays, some of the resistors look like they have a solid connection through the resistor (which would short them out). This is just a coincidental alignment of a module pin with the resistor in the image. 

  3. The other unexpected feature we uncovered from the X-rays was resistor R6. During probing, I had also missed the presence of R6, since it was not used by this board. 

4 comments:

Brian Willoughby said...

Would it be possible to detect complex passive circuits using an Impulse or Frequency Sweep as input?
The Impulse Response could be directly converted to a Frequency Response - which might hint at circuit topologies with only a few poles and/or zeroes. A Frequency Sweep could also be processed to reveal a Frequency Response.

You eventually hand-picked frequencies to test, once you knew what the X-Ray revealed, but I'm wondering if a generic technique would work (for passives like this circuit).

SeanB said...

Am going to assume those modules were parts Motorola used for many of the 1950's and 1960's era products, probably the military radios and other industrial equipment they made. After all, the potting line for it was, from appearance, something they knew well how to do, so they had to have made custom modules for use, with the regular line being done in mass for products, otherwise the modules would likely only have been conformal coated with a pin base to align to the sockets.

Yes the zener was not used, or was used in another application, probably to give a reference voltage or power supply for a separate module, that was a differential amplifier, and they used this module for the pins.

Hans said...

I really appreciate your work! Are there any plans to detail updata demodulation? As far as I know, Phase-shift keying demodulation is a difficult task (coherence et cetera).

Thank you very much for your efforts!

Anonymous said...

Nice work keep up the good work! From north of Sweden.