Technogubbins: lifting the bonnet on digital We’re Stuck
Hello! I’m and I’ve been working with Sarah and the wonderful One Tenth Human team to work out how to translate the excitement, interactivity, and immediacy of the live show onto a digital stage.
Our goal was to keep the technical setup as minimal as possible. Could it even all be operated by one of the performers? That would make the show much more viable as an ongoing project. That meant no huge processing rigs, stream-decks or other technogubbins. Especially as the show would most likely be performed from the actors’ houses, the less extra gear the better.
And how many performers did we need? If we’re on Zoom, could we pre-record at least one of the performers? Could a performer interact live on Zoom with a pre-recorded robot played by themself?
Yes.
With a bit of effort.
The audience joins the show through Zoom, and all prerecorded video, sound effects and interactive elements had to be wrapped up into one easy feed. The important thing was that any prerecorded bits had to feel like they were as live as the rest, so no screensharing. After dabbling with QLab, Syphon, Black Hole, Terminal, CamTwist, Voicemeeter, VB Audio, Loopback, VirtualCam, Steamlabs, OBS and NDI video (phew!) we found a simple and stripped back solution.
Open Broadcast Software (OBS) is free, open-access, doesn’t need any extra licenses or plugins, and is
capable of handling feeds from anywhere on the computer. It was created for streamers, not theatre-makers, so the terminology is a bit different. Take a look:
Scenes (bottom left): This means cues.
Sources (bottom middle): The various video, audio and interactive elements could be input here and arranged for each cue individually
View Window (top middle): This is the preview of how the feed would go out to audiences/classrooms.
OBS has various key commands built in, but we added our own hot keys. It has an easy preferences menu for that stuff.
OBS was created to stream to YouTube or Twitch, so we used two extra pieces of software to get Zoom and OBS to talk to each other: , a program that can turn any screen into a camera feed in Zoom; and a virtual audio cable.
(There are a few “virtual audio cables” out there but there aren’t many options if you’re on Mac: Loopback has cornered the market. The full license cost us about £100 – the free version only gives you twenty minutes use at a time before the quality is reduced. If you’re on Windows, the from VB-Audio is a free and reliable option.)
Why not QLab? I hear you ask! Of course QLab is an industry standard for cueing shows. Partly this was a cost issue: a video QLab license increased the running costs. Partly it was to do with the interactive animations that were a vital part of the show – see below.
Everything ran through a mid-level MacBook without any issues (and would also have worked on a Windows laptop). As the laptop was only being used for the show we could strip out a bunch of processes that were slowing it down or causing streaming to be laggy: programs automatically loading on start-up; passive processes like Spotlight.
In his bedroom, the amazing Seiriol Davies set up his mobile phone as his live feed into the Zoom call; and the magic laptop just out of sight below, feeding all our “Scenes” into the call via OBS.
He wasn’t just cueing pre-recorded video. He was controlling the unique interactive videogames I’d created. Everything is written in a game engine called (highly recommended to anyone who wants to give game design a try. It has a really low barrier to entry, great guides to get going, and you don’t need to know a single line of code to get started). Hot keys triggered animations in response to our live audience commands.
To keep the recorded bits and the interactive bits looking coherent, we filmed the actors in front of a greenscreen. This way they could be plunked into a variety of scenes.
For specific movements in the interactive sections, character movements were pulled from video, frame by frame, to become discrete animations, which could be cued by hotkeys. This is how Seiriol and Clare became videogame characters!
If you’d like to see a little of how all this worked in action, take a look at our video trailer here.
If you’d like to know any more, please do get in touch; or if you’ve been doing live Zoom adventures completely differently, and would be up for sharing your learning, we’d love to hear from you!
1 July 2020
We’ve now delivered our interactive Number Board adventure to 76 people, including six classes in a Primary PRU (some of the loveliest audiences we’ve ever had).
We’ve solved some of the “front of house” issues we were having, and discovered some new ones when working with schools.
Inspired by Angel Exit’s Super Spy Adventure, we found a better way of exiting a session. Astro-bot, our rogue killer robot, might be tracking the call! So we all have to leave the session together: hovering our fingers over the “leave” button, we count down together. “3, 2, 1 – byeeeee!” Much cleaner and more satisfying. (My performers, in Stratford and North Wales, in fact hit “stop video”, so I can shout from Lancashire to bring them back out of hiding when the audience have safely gone.)
Our first in-school session started a little stickily. I had discussed the technical set-up in advance with my contact, and teachers were well-briefed. However, when “Dr Dikita Dey” arrived, she was met with a teacher having problems hooking the sound up between laptop and interactive whiteboard, and found herself struggling to answer queries about what kind of laptop she was using whilst remaining in character. Subsequent sessions started with me on the call, checking everything was set-up, before connecting “Dr Dey”.
On a Zoom call it’s tricky for performers to manage interactions with a group: you can’t point to the child you’re inviting to speak. One teacher suggested we put big numbered labels on each child – but we felt deeply uncomfortable at the idea of calling on “child number 7”!
We partially solved this by having each class give themselves a “laboratory name”, and asking teachers to send us those plus lists of first names before each session. That made it easer for Dr Dey to match names to faces: “Yes, someone in Super Slime Lab has an idea! Professor Logan, what do you think?”
With small PRU classes, this worked well. However, we want to move on to full classrooms: watch this space as we grapple with some potential solutions….
We’re also grappling with technical challenges. We plan to create a new version of We’re Stuck in four episodes, delivered by live performers with some pre-recorded sections. This week I learned how to use QLab, Syphon, Black Hole, a Terminal hack plus CamTwist to send a pre-recorded video into a Zoom call as if it’s live. They didn’t teach me that stuff in drama school!
It’s breathtaking how quickly we’re all having to skill-up, and I’m enormously grateful to all the people who are generously sharing knowledge, such as Angel Exit, Unlimited Theatre, Ovo, and the extraordinarily brilliant Joshua Pharo.
If you or someone you know is also exploring live, interactive, digital theatre, we would love to hear more – and very happy to share more detail on our process if useful. Do get in touch.
So, this week I learned how to use QLab, Syphon, Black Hole, a Terminal hack plus CamTwist to send a pre-recorded video into a Zoom call as if it's live.
They didn't teach me that stuff in drama school.
It's breathtaking how quickly we're all having to skill-up, and I'm enormously grateful to all the people who are generously sharing knowledge, such as Angel Exit, Unlimited Theatre, Ovo, and the extraordinarily brilliant Joshua Pharo.
It's exhausting and exhilarating. And it's so so worth it.
We just delivered our interactive Number Board adventure to eight classes in one day at a Primary PRU. From his parents' downstairs toilet in North Wales, award-winning certified genius Seiriol Davies inspired childish giggles and adult guffaws as “Dr Ernest Volcano”. From my spare room in Lancaster, I pretended to be his hands whilst pressing go on QLab. And from her RSC digs in Stratford, the amazing Avita Jay held it all together, inspiring those kids to stretch their brains and save the day.
I don't know how many of those kids have been to the RSC recently. I'm making an appalling assumption, probably, but I suspect not many. If any.
It's astonishing how much better this awful time feels when you get to see kids like those experience performance delivered by brilliant artists like Seiriol and Avita.
Anyway. Stop being sentimental, Punshon.
We've solved some of the “front of house” issues we were having, and discovered some new ones.
Inspired by Angel Exit's Super Spy Adventure, we found a better way of exiting a session. Astro-bot, our rogue killer robot, might be tracking the call! So we all have to leave the session together: hovering our fingers over the “leave” button, we count down together. “3, 2, 1 – byeeeee!” Much cleaner and more satisfying. (In fact, Seiriol and Avita hit “stop video”, so I can shout from Lancashire to bring them back out of hiding when the audience have safely gone.)
On a Zoom call it's tricky for performers to manage interactions with a group: you can't point to the child you're inviting to speak. One teacher suggested we put big numbered labels on each child – but we felt deeply uncomfortable at the idea of calling on “child number 7”!
We partially solved this by having each class give themselves a “laboratory name”, and asking teachers to send us those plus lists of first names before each session. That made it easer for Dr Dey to match names to faces: “Yes, someone in Super Slime Lab has an idea! Professor Logan, what do you think?”
With small PRU classes, this worked well. However, we want to move on to full classrooms: watch this space as we grapple with some potential solutions....
We're spending the summer working on a full narrative arc: We're Stuck as a series of episodes to be delivered in over several weeks this autumn term (and hopefully beyond).
If you know a school who might be interested in hosting the adventure, do let us know: thanks to our ACE funding we can offer generously subsidised rates for several weeks' worth of curriculum-linked creative maths activity.
And if you or someone you know is also exploring live, interactive, digital theatre, we would love to hear more – and very happy to share more detail on our process if useful.
More soon...
I had to sack my husband this week.
(Not from being my husband. From a project. This project, to be exact.)
Dan Bye's been involved since the very beginning. He was part of initial workshops at Ovalhouse, devising sessions at Shoreditch Town Hall and the Unicorn Theatre, endless schools workshops across south London, two rehearsal periods and national tours. The show would not have been what it was without him.
Not just in the “he asked great questions” kind of way: I remember him and Seiriol sitting in a corner giggling as one of them typed up a ridiculous scene they'd just devised together, which is in the current script almost word for word.
Dan's ability to immediately put an audience at ease, his warmth with all kinds and ages of child, his absolute liveness and genuine responsiveness. His daft jokes and terrible Dad dancing. All written into the fabric of the thing, essential to its operation.
But he's out.
Of the digital version, anyway.
It came down to economics.
We're committed to We're Stuck: the digital adventure reaching the kinds of kids who are most likely to be in need of its joyful message of resilience and optimism. The ones who get marked down due to unconscious bias, who don't think STEM is for “people like them”.
So we're going into schools.
We've had some hugely enjoyable family audience tests, and we may yet do more. But the barriers to booking an unfamiliar Zoom adventure starring no-one off the telly are high, and we've no reason to believe that future audiences are likely to be any less white and arts-savvy than the small test audiences we've had fun with so far.
The pattern will be familiar to anyone who's ever worked on a children's show that isn't on at Christmas and isn't Peppa Pig or Something Else Off The Telly: schools audiences gloriously diverse; family audiences overwhelmingly white and middle-class.
So the focus has to be schools.
We're hopeful and excited about this. For years, I've been part of conversations where venues and companies worry increasingly desperately about the problem of persuading schools off-site: for many schools, with budgets getting tighter and tighter, getting out to a theatre show is off-puttingly expensive even before you add in the cost of coaches and the hassle of travel. So to be able to dive straight into the school, Zooming into the classroom via the interactive whiteboard: there's a genuine opportunity here. Plus it's hopefully more appealing for performers than traditional TIE: no getting up at 6am to unload a van, do several shows in an acoustically-challenging hall before loading everything back in again. Win-win, surely?
And yet the economic model is still enormously challenging.
At the moment we're in the privileged position of using an Emergency Arts Council grant to create this digital experience. But can we make it sustainable beyond this brief window, without subsidy?
Our brilliant actors need to be paid – say, £150 per day. Not a particularly generous rate to deliver 6-8 twenty minute “shows” in a day, when you might only have one of those days in a week. The company needs to market, schedule, pay invoices for each series.
How much can schools afford to pay for several weeks of curriculum-linked creative content?
Not much.
So as with every show I've ever created, the number of live actors becomes the key parameter.
We're getting creative with this: as I wrote last week, working out ways to mix pre-recorded with live means we can have more than two characters on screen at once. It means characters played by the same actor can talk to each other, allowing for even more exciting plot twists.
And there came a point when I realised: we can do this without Dan. It'll be more affordable, easier to schedule, PLUS the audio quality will be better with fewer people on each Zoom.
So that's what we're doing.
His characters have been written out, though some of his jokes remain. We're negotiating a payment for Intellectual Property Rights. And on we go. It'll be fine. I'm excited to work on this new version of the project, and know that Dan totally gets it.
But I keep thinking about the economic model. Of the problem of subsidy versus “sustainability”. Of the problem of liveness, which is so horribly expensive and yet the thing I yearn for desperately whenever I make myself sit and watch the latest streamed show.
(Dan gets it. His latest piece is entirely digital yet genuinely live, and features no expensive performers whatsoever: I heartily recommend trying it.)
I keep thinking of how the economic model theatres have been striving towards for years – less and less subsidy, more and more box office – recently collapsed, and for a brief window those who rely more on subsidy seemed more robust than those who've been brilliantly successful at building other income streams.
I'm all in favour of selling tickets, I'm absolutely not suggesting we shouldn't be striving to sell as many as possible to as wide an audience as possible. We need to value our work, be proud and know it is worth spending money on, that if they can afford to, people are willing to pay good money for a brilliant night out, and if you can't get a big enough section of your local community to buy tickets in your theatre you need to take a long hard look at whether you're actually providing a good enough night out.
But we also need to acknowledge that even hard-nosed commercial producers require subsidy to make their shows.
And also. Kids like the ones I met last week in a PRU have a right to experience fucking brilliant theatre. They deserve it. And they absolutely can't pay for it.
There is no viable economic model for providing world-class theatre to those kids. Whoever pays for it won't get their money back.
Not in cash. Their return will be paid in something far more precious.