Sony Music x Fortnite Concert Series

Studio: Sony Immersive Music Studios
Role: Senior Gameplay & UI Engineer

Platforms

Windows PlayStation 5 Xbox Nintendo Switch

Platforms

Unreal Engine 5 C++ UEFN Verse

Overview

As part of a partnership between Sony Music and Epic Games, the team at Sony Immersive Music Studios created a series of virtual concerts published on Fortnite’s UEFN platform

This music series was released as a series of limited-time events, encouraging a concert-like experience while driving strong player engagement around music artists’ timed releases and promotions

Contributions

  • As lead engineer, collaborated with the lead designer to build a design and engineering pipeline for Fortnite concert gameplay
  • Defined a set of questions to clarify music artists’ artistic vision within scope constraints
  • Defined design document language for breaking down songs into playable sequences
  • Partnered with Move AI to record marker-less motion capture data using multi-camera setups
  • Built tools in Python to detect and flag abnormal or corrupted animation data
  • Built tools pipeline for converting Move AI data into animations on a MetaHuman skeleton
  • Collaborated with tech artists to develop animation tools tailored to production needs
  • Built an export pipeline that outputs animation data at multiple levels of detail, supporting a range of platforms including Fortnite (UEFN), Unreal Engine 5, and Roblox
  • Built a live-editor tool to transfer assets between Unreal Engine 5 and UEFN, enabling tech artists to leverage existing UE5 pipelines when creating UEFN-compatible assets

Concerts

Myles Smith

Sleepy Hallow

PARTYNEXTDOOR

Publications