Ants’ complex caste system may be partly controlled by the insect version of the blood-brain barrier, a gatekeeper that only lets certain substances into the brain, a new study reveals.

An anthill is a meticulously organized community of insects, with clear divisions of labor to ensure smooth operation. While the queen lays eggs, worker ants either forage for food or protect the nest as soldiers, and the ants’ hormones, including one called “juvenile hormone,” dictate which role each ant plays.

However, the underlying molecular controls that regulate these hormones to shape social behavior have not been well understood. Now, a recent study has shown that the blood-brain barrier (BBB), the filter that protects the brain from unneeded or potentially harmful substances, plays a role in this process. The findings in the journal Cell, indicate that the ant BBB regulates hormone levels entering the brain, thus influencing worker ants’ roles in the colony.

In the study, researchers set out to understand the basis of the behavioral differences between forager and soldier ants. They investigated which genes and proteins were expressed differently among these two classes of worker Florida carpenter ants (Camponotus floridanus). They discovered that an enzyme that breaks down juvenile hormone, called juvenile hormone esterase, was present only in the cells that make up the ants’ BBBs.

Their analysis revealed that soldier ants had higher levels of juvenile hormone esterase than foragers did, and therefore, less of the hormone was making it into the soldiers’ brains. When the researchers injected juvenile hormone directly into the brains of soldier ants, bypassing the BBB, the ants abandoned their mercenary role and started looking for food. The ants showed a similar shift in social behavior when the researchers reduced their supply of juvenile hormone esterase by manipulating the gene that produces it. Without an enzyme to break it down, juvenile hormones reached the ants’ brains and reprogramed their behavior.

Previous studies had reported that the BBB may regulate the hormone levels in the insects’ brains, study co-first author Karl Glastad, a researcher at the University of Pennsylvania, told Live Science in an email. “However, the fact that the ant blood-brain barrier was dynamically regulating juvenile hormone between these two worker types in a way that controlled such an important behavior was definitely surprising to us,” he said. “That the access of juvenile hormone to the brain is regulated so tightly at the level of the blood-brain barrier is a really cool finding,” Daniel Kronauer, an evolutionary biologist at The Rockefeller University who was not involved in the study, told Live Science in an email.