Networked and smart home devices are increasingly commonplace—from Alexa to Nest to Amazon’s new voice-activated device—although these developments aren’t always for the best. While some have raised concerns about privacy, the idea of collecting more information about how people react to specific environments has been appealing for researchers around interior design and neuroscience for many years. The idea of a smart office is becoming more commonplace too, moving into the future through using novel technologies to maximise productivity and create a better working environment overall.

This year, at the Salone del Mobile in Milan, Google and Johns Hopkins University teamed up to unveil an interactive installation focused on the area of neuroaesthetics, which examines the relationship between the brain and visual input. The installation, called Space for Being, had themed rooms with different names. Google’s head of design for all hardware products, Ivy Ross, and architect Suchi Reddy chose a range of furniture, colours and materials to evoke specific emotions. Each visitor, upon entry, was fitted with a Google-designed biometric band which measured their heart activity, breathing rate, temperature and body motion, all of which was collected for assessment by researchers from Johns Hopkins University at the end.

In some sense, these fields of research have already existed for many years—interior design, architecture and other areas of research around the built environment look at how people respond to the space around them. Common knowledge dictates that a child’s nursery shouldn’t be painted in tints of bright red or lime green, and increasingly, modern offices tend towards minimalism and neutral decors to absorb multiple businesses or companies. Research has indicated that the environment which you’re in can affect your mood.

When it comes to the modern workplace, these concerns get turned into fears around productivity, whether it’s finding out how it could be increased, or what problem areas there are. If workplaces were able to collect data about how employees actually reacted to their physical environments, the logic is that they should be able to make fixes or tweaks which could improve productivity.

To some extent, this kind of monitoring, and this small scale collection of data about minute details of our lives, is already very commonplace. Fitbits have surged in popularity in the last few years, and there are a whole host of other tracking technologies which people already willingly use. So perhaps it’s unsurprising that the new workplace (and the people who design it) would want to use some of those insights.

In theory, this could mean that smart offices are able to measure some of the mildly uncomfortable things about working in an office environment. Do you spend the majority of your day shivering, or constantly fidgeting because your chair is uncomfortable? Does your concentration rate drop off after a certain length of meetings? Those ideas sound innocuous enough, especially if they’re geared toward making minor changes around convenience. But they could be potentially troubling too.

As other research has suggested, networked devices and smart home gadgets can often be turned into tools of monitoring, 1984 style. At least in a house, the idea is that people could turn off these devices or disable their capabilities. But in a professional environment, individual employees don’t have that much autonomy if an employer decides to deploy a new, productivity-enforcing technology. That could include monitoring how much people use their phones at work. It’s also worth remembering that these conversations around smart offices ignore that blue collar workers—such as those who work in Amazon warehouses—are already subject to this kind of micro-monitoring, through biometric bands, but have few other options, or ways that they can meaningfully resist.

On one hand, this could have benefits for employees on a very minor scale, such as adjusting temperatures in different rooms, or potentially reducing the length of meetings. But at the end of the day, that’s the kind of problem which could be solved by better communication, or asking employees for feedback regularly. In reality, no one really wants your employer to have information on all of the things you do, whether it’s networked devices in the office which measure how long you’ve been away from your computer, or how sleepy you feel after a meeting. A careful line has to be tread between minimally invasive products and ones which could be actively harmful, particularly once workplace dynamics are taken into consideration.

There are privacy concerns as well. In the Google installation, visitors could see that their data was being erased right in front of their eyes. Although the data that’s collected through bands like these are arguably not that incriminating—who’s heartbeat doesn’t speed up slightly when they’re giving a presentation, for example—it’s more the principle of a data leak which could be worrying. If the workplace of the future can surveil employees in these ways, some would argue that it’s a slippery slope until they can start tracking employees in other ways too.