ISNESS FEATURED AT CONSCIOUSNESS CAMP
This weekend ISNESS featured at a virtual Burning Man conference, Consciousness Camp, alongside Marshmellow Lazer Feast, ÆRTH, Technosocial and The Museum of Consciousness.
The event comprised a two day salon of presentations and discussions and is part of The Museum of Consciousness, a project by curator Carl H. Smith, director of the Learning Technology Research Centre (LTRC) and research fellow at Ravensbourne University, London
PERCEPTIONS AT THE NANOSCALE
David Glowacki. First published in Nature, May 7 2019
Artistic imagination can help drive scientific imagination.
Building on psychology and neuroscience research linking multisensory processing and attention, our laboratory actively integrates both artistic and scientific practices to develop technologies for enabling multisensory perception of nanoscale dynamics, exploring perceptual channels beyond vision — for example, audio, touch and proprioception.
Our work has highlighted a number of applications where multisensory approaches enable more intuitive (and efficient!) nanoscale design and engineering. This is a relatively unexplored territory for nanotechnology research, requiring deep and symmetric exchanges between aesthetic practice and scientific practice, but it has the potential to usher in a new paradigm for nano-engineering, improving our dynamical intuition and our ability to communicate.
TARA: A MEDITATIVE ART PRACTICE AND COLLABORATIVE LOCKDOWN PROJECT
During the pandemic, labs and institutions across the world shuttered their doors, as scientists and artists did our best to adapt to working remotely to continue our studies.
The IRL remained active during lockdown, adapting our Isness co-located multi-person VR experience into a distributed format in which participants could dial in across the globe.
Part of this research was conducted from a remote lab node established at D’Alijo Retreat centre in the mountains of Northern Portugal.
iMD-VR to study COVID proteins
Interactive Molecular Dynamics in Virtual Reality Is an Effective Tool for Flexible Substrate and Inhibitor Docking to the SARS-CoV-2 Main Protease.
Our recent paper shows how our open source interactive molecular dynamics in virtual reality (iMD-VR) program Narupa can be used to investigate proteins which are relevant to the ongoing COVID pandemic. In the paper, we looked at the main protease (Mpro) of the SARS-CoV-2 virus, which is one focus of drug development efforts for COVID-19
Crowd-sourced machine learning for NMR
The rise of machine learning (ML) has created an explosion in the potential strategies which may be used to learn from data in order to make scientific predictions. For physical scientists who wish to apply ML strategies to a particular domain, this has created a bewildering scenario, where it is difficult to make an a priori assessment of what strategy to adopt within a vast space of possibilities.
To address this search problem, we recently we teamed up with Kaggle to initiate a crowd-sourced community competition for searching and analysing the space of possible ML strategies in order to predict pairwise NMR properties. Over 3 months, we received 47,800 ML model submissions from 2,700 teams in 84 countries, surpassing anything we could have achieved on our own. Analysis of the results shows that it is possible to construct ensemble-based ML models as linear combinations of the top 50 submissions, which have a prediction accuracy better than any individual model, and are nearly 3 orders of magnitude better than our previous approaches.
How to visually describe ISNESS: A lightpainting exploration
Communicating the experience of ISNESS to those who haven’t experienced it is difficult, and the in-world visuals are so subtle that they do not convey it’s beauty when seen as footage or stills. While developing ISNESS-D it became even more apparent that we wanted imagery to help us describe the experience we were about to offer to people we may never meet in person! This inspired the team to arrange a photoshoot to create images which better illustrate the ISNESS experience.
ISNESS receives best paper award at CHI 2020
Our paper “Isness: Using Multi-Person VR to Design Peak Mystical-Type Experiences Comparable to Psychedelics” (doi:10.1145/3313831.3376649 & arxiv.2002.00940) has been recognized with a best paper award at the 2020 ACM CHI Conference on Human Factors in Computing! Less than 1% of all paper submissions receive this award, so it’s really exciting!
The paper describes our efforts adapting “Narupa” (our open source VR software platform) to elicit ‘mystical-type experiences’ comparable to those reported by participants in psychedelic psychotherapy sessions. It builds on a body of work by a number of researchers, including Prof. Roland Griffiths, a psychiatrist and neuroscientist at the Johns Hopkins Centre for Psychedelic & Consciousness Research, who has investigated both naturally occurring & drug-induced ‘mystical type experiences’, and also Dr. Robin Carhart-Harris at the Imperial College Centre for Psychedelic Research, who speculated in a March 2018 paper that psychedelics combined with VR might have therapeutic benefits in a neuro-psychopharmacology context.
ERC support
Super excited to announce that the European Research Commision (ERC) has agreed to fund a project called NANOVR (NANOscale design using Virtual Reality) under their ‘Consolidator Grant’ scheme. The ERC’s generous financial support will commence in summer 2020, enabling us to continue our efforts developing the Narupa VR tools as open source community resources, and carry on exploring all sorts of interesting research applications across domains like biochemistry, materials engineering, and nanoscience!
VR for teaching biomolecular physics
Really exciting to see work by Dr. Simon Bennie featured on the cover of this month’s issue of the Journal of Chemical Education. The paper, which you can access here, outlines how Narupa, our open-source VR-enabled interactive simulation framework, was applied to develop a computational laboratory exercise enabling undergraduate students to better understand the dynamics and interactions that guide drug-protein binding.
ISNESS AT BREAKING CONVENTION - study
On the 16/17/18th August we presented a multi-person immersive VR experience called Isness at Breaking Convention at the University of Greenwich in London.
Sessions were run six times per day with 70 conference attendees experiencing Isness and the team running the sessions at scale for the first time.
The feedback was really exciting and the data and observations will soon be available as a paper. We are excited to share this new project with you!
OPEN SOURCE VR GLOVE WORKSHOP AT THE IRL
This week the IRL hosted etextile designers Rachel Freire and Becca Rose who have collaborated to develop an open source ‘Mudra’ VR gloves. The DIY glove design is compatible with the HTC Vive, breaking out the pins on the Vive Tracker and mounting it on the wrist of a DIY etextile glove design.
Our VR lab was temporarily repurposed as a makerspace to facilitate the creation of four brand new pairs of gloves and to repair and upgrade two existing pairs. The design was prototyped by Becca Rose, working from Rachel Freire’s open source designs and the ‘Mudra’ glove made in our workshop is an updated design developed specifically for the IRL team to use in Narupa.
Training neural nets using data harvested in virtual reality
New open-access paper from the IRL showing how interactive quantum chemistry in VR can be used to efficiently train Neural Nets to learn potential energy functions. As an ‘Editor’s Choice’ paper, it was featured on the cover, and is already one of the journal’s most read papers.
Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework
An open-access paper describing our open-source iMD-VR framework Narupa has been published as in J Chem Phys , and it’s been selected as the “Editor’s Pick featured article”. It’s also scheduled to appear on the journal’s cover, featuring an image made by IRL PhD student Alexander Jamieson-Binnie.
Narupa builder prototype
The IRL have just released a prototype for a molecular builder, the latest addition to the open-source Narupa family Features are being actively developed right now… if you have ideas or features you’d like to see (or bugs to report) let us know via the GitLab issue repository
iMD-VR for flexible protein-ligand docking
We’ve just published a paper describing the use of interactive molecular dynamics in virtual reality (iMD-VR) for carrying out flexible protein-ligand docking, demonstrated through experiments carried out docking drug molecules into the binding pockets of trypsin, neuraminidase, and HIV-1 protease.
Narupa: open-source beta exectuble
We’ve just published an open access article (arxiv.1902.01827) describing Narupa, our open-source multi-person iMD-VR (interactive molecular dynamics in virtual reality) framework. To go along with the article, we’ve published a stable beta executable of Narupa, available at irl.itch.io/narupaxr.
The executable is effectively a build of the source at gitlab.com/intangiblerealities. If you want to set up your own multi-participant VR lab, instructions are available here.
THE INTANGIBLE REALITIES LABORATORY
Now that we have a shiny brass plaque, the IRL is official.