Saturday, November 24, 2012

Can Artists Be Agile?


There is a lot of conversation about agile methods lately.  Buzzwords like Scrum, Kanban, sprints and daily stand-up meetings are tossed around endlessly.  Most of the conversation revolves around how programmers and engineers have clearly found some benefit in applying these practices to overcome the uncertainty and complexity of creating technology.
But how can agile benefit creative side of product development?   Is there any benefit from agile for artists, designers, musicians and all the other creative disciplines?
This article provides a simple introduction to agile and describes the precedents, challenges and examples for applying it to the creative arts.

What is agile?
Agile is an approach to creating products that has grown in response to challenges the software industry has faced with the emergence of powerful and cheap computers driving the demand for increasingly sophisticated software.  Creating such software is challenging due to its size and complexity and many projects fail to achieve their targets of cost and performance.  As a result there was a drive, decades ago, to do more up-front planning of projects: to write huge requirements specifications that attempted to eliminate the uncertainty of creating software that no one had ever seen before.
Sadly, the result was that even more projects failed.  The truth is that we cannot plan our way out of uncertainty.  Agile practices arose in response with the fundamental principles that uncertainty requires experimentation and that knowledge workers are craftspeople and not factory workers.  They had to use their skills and creativity to achieve something new and not mechanically follow a set of predetermined instructions.

The challenge
The practices of applying agile, commonly labeled as Scrum, Extreme Programming or Kanban, have emerged over the past decade as a way to help teams of programmers become agile.  These practices have been shown to work[1] in improving the creation of new software products and the working environment for programmers.
The challenging question is “can the creation of art benefit from agile practices?”

Precedent
There are many examples of “artistic agility” that go back centuries.
One of my favorite examples of this approach applied to art can be seen in many examples from centuries ago.  Artists were hired by wealthy patrons to paint their portraits.   Like everyone else, a patron is going to be the most sensitive about how his or her head appears in the portrait, and less concerned about anything else.  If they reject the portrait, it’s usually because they don’t like how their head looks.  So an artist would paint the head and leave everything else in the portrait nearly blank.  If the patron approved their head, they would finish the rest of the painting.  If they rejected it, then the artist would start a new portrait, but they would have wasted little paint and time.
This is the same approach that agile practices take; to create the most important bits first and judge where the product is heading before taking the next step.

Figure 1 - A partially complete portrait

There are many examples of how successful creative efforts have emerged by course correcting after an early failure.  For example, Pixar reset movies in the Toy Story [2]series because their initial production results lacked enough character development.  
Early creative vision is rarely perfect.  It has to be reshaped to some degree.  The fundamental truth is that we can’t plan our way out of uncertainty.  We have to experience the important parts first, whether on a monitor or canvas, and use what we see to steer our emerging plan.

Agile practices for artists
Over the past decade or two, the technical disciplines have invented many agile practices such as pair-programming, unit testing, continuous integration and automated testing.  These practices have greatly helped them improve their agility.  Artists don’t have such an extensive set of comparable practices, but there is no reason they can’t become equally agile as the technical disciplines.
The reason can be seen within the Agile Manifesto[3] — a list assembled in 2001 by some of the leading agile thinkers—which describes the values behind agility:

Manifesto for Agile Software Development
We are uncovering better ways of developing
software by doing it and helping others do it.
Through this work we have come to value:
Individuals and interactions over processes and tools
Working software over comprehensive documentation
Customer collaboration over contract negotiation
Responding to change over following a plan
That is, while there is value in the items on
the right, we value the items on the left more.
The manifesto seems focused on software development, but that’s because the authors were mostly programmers.  The values apply just as well to other disciplines.  Let’s look at the first value, “Individuals and interactions over process and tools” as an example.
Imagine that you are an animator working on a character that has a special physical effect (say stretchable arms).  You’ve received new tech for this effect from a programmer.  So you tune the necessary controls for this new effect and export them.  Much to your surprise, the new effect doesn’t work.  There is a bug.
In a traditional process, you might tell your lead animator about the problem and continue on with other work.  The lead, in turn, will report the bug in a bug-reporting tool or in conversation with the lead programmer.  The lead programmer might then assign the bug to be fixed by a programmer next week (see figure 2).  The next week you receive a new version of the effect and, hopefully, it works.


Figure 2 - A typical hierarchy of disciplines

Does this scenario sound familiar?  If it does, you know the potential pitfalls of such an approach:  the fix might not be what you needed, you had to wait a week for the fix, or it just gets forgotten.
An agile framework, like Scrum, approaches this differently.   Scrum centers around cross-discipline teams who commit to delivering completed features in the order of their importance.  In the example above, a cross-discipline team, which includes artists and programmers, commit to delivering a character with stretchable arms in a few weeks.  When the animator encounters a problem with the stretching technology, they can speak directly with the programmer on the team about the problem.  Because teams succeed or fail to deliver a feature as a team, there is a strong motivation to solve problems fast.  Problems are fixed quickly because the team focuses on the character and not their own set of isolated tasks.
Agile practices focus on delivering value early whether that value is showing a key effect or the head of a subject in a portrait.

Agile artistry in action
The modern application of agile in the creative arts emerged almost ten years ago in the video game industry.  The reason it took root there is simple.  The cost and size of video game projects was doubling every two years to the point where, in 2003, a typical mass-market console game required over 75 people and $20 million dollars to complete.  This was growing larger than most movie budgets and created a lot of risk.  A single game’s failure in the market could put a studio out of business.
The need to reduce risk -- while still exploring creative ideas -- led studios like High Moon[4] to explore agile practices.  The largest part of a video game team consists of artists, so it became imperative to find agile techniques for modeling, texturing, animating, mixing, etc.  Practices, such as “dailies” were combined with Scrum’s “daily standup”.  Small cross-disciplined teams of no more than ten developers slowly formed, whose goals became to demonstrate a character or level of the game that was “more fun than the last iteration”.  When a feature or asset was not as fun or beautiful as expected, plans were altered to change course.
The success of a creative product primarily depends on the talent and imagination of its creators, not the method of development.  However, the introduction of agile practices led directly to a reduction of cost and waste that are typically seen in game development.

Fears
“Could I have worked under a system where there were Draconian controls on my creativity, meaning budget, time, script choices, etc.? Definitely not.” - Michael Mann, Director
A major barrier to finding ways to improve the process of creating assets is with the aversion to process that many artists feel.  Artists often view the creative process as an organic thing that cannot be analyzed, dissected, or reduced to a set of defined practices without killing it.  As a result, they see methodologies as cold instruments from a mechanistic world they don’t belong in.  Experiences with managers who haven’t understood this mindset have further validated this feeling. 
Overcoming this aversion to process requires an understanding of the role of process itself.  Process cannot automate the creation of beauty.  It cannot remove uncertainty without exploration.  It can’t replace communication among a diverse set of craftspeople that must work closely together to create the best results.
Exposing artists to improved practices has to start with a less prescriptive but more visual approach, and lots of communication.

Conclusion
Agile practices work.  They’ve been proven in a wide variety of creative arenas from video game concept development to CG film post-production.  However, it’s not as easy as it might seem.  The means of becoming truly agile does not demand that you must follow practices out of some book.  Agility requires you to adapt your workflow to better inspect your studio’s creative output and react to what is emerging.   It’s about creating transparency, which exposes the daily impediments to creative expression.  Fixing those impediments is up to you and your studio.  It results in a better environment to work in, but it’s not easy to get there.


[1] http://www.versionone.com/pdf/2010_State_of_Agile_Development_Survey_Results.pdf
[2] Toy Story (10th Anniversary Edition) - (Filmmakers Reflect) (DVD). Walt Disney Home Entertainment. September 6, 2005.
[3] http://agilemanifesto.org/
[4] http://highmoonstudios.com/

Friday, November 23, 2012

Lean Thinking and Visual Effects Industry


The scale and complexity of Visual Effects continues to increase at extremely high rates.  This can be clearly seen in the amount of visual effects shots found in current Audiovisual Productions (Films, TV Series and Games).  Even films that aren´t effects related can contain hundreds of invisible visual effects shots.

At the same time, fast advancements in technology allied to tax incentives offered by several countries have allowed for new VFX boutiques/facilities to be formed as well as for large VFX facilities to open offices around the world in order to attend this increasing demand while trying to lower the cost of their operations.

This has direct impact on the amount resources, companies and professionals required for the creation and production of Visual Effects.

Which impacts how these projects and professionals are managed and on the relationship between the stakeholders: artist, facilities and clients.

The current management methods, tools and techniques used by most of the companies around the world were developed at the end of the 19th Century/beginning of the 20th Century for the specific kind of work at that time, of repetitive nature required in factories.  These methods have not evolved at the same rate as the complexity of the work has and are not suitable to attend the requirements of this new era.

They could have been useful several years ago when the projects didn´t have the kind of scale, complexity and didn´t involve so many people as they do today.

The VFX Industry is going thru some really tough times as it can be stated by talking to VFX Artists working in studios around the world, reading several online articles, blogs, forums, by reading the VES Letter.

All of the issues discussed on the VES Letter are impacting the VFX Market in several ways.  Some of them are here to stay and many will hopefully be solved but this is something that will take time.  While we wait we continue to see VFX Studios around the world shutting down, Down Sizing and Artists going thru some very sad experiences, from being layed off to being exploited in several ways.

Times are tough: delivery timeframes are getting shorter, budgets lower while project complexity and competition from emerging countries, offering lower labor cost, continues to increase.

But it is in times like this, when you are faced with extreme constraints and conditions, that open up opportunities for improvement and Innovation.

So I believe this could be a great moment for the VFX Studios to take action, look inside and find opportunities for improvement in the place where they have the most control.  Inside themselves.

Change comes from within.  In order to expect change from others we should start by changing ourselves.

Big changes are hard and the best way to start is by changing the things that are directly in our control.  So this is a good time to review the current methods and research for new ways to manage projects, artists, facilities and client relations.

“Our own worst enemy: how the burden of what we know limits what we can imagine”

It is time to step back, think outside the box and visualize the creation and production of Visual Effects from a new perspective.

I believe that Lean Thinking and Management principles can play a very important role in supporting the
VFX industry to adapt and succeed in this complex environment as it has done for other knowledge industries such as Software Development which has gone thru the similar kind of problems as the ones VFX studios are facing today.

It can definitely offer new ways to develop a healthy environment for VFX and specially for the Artists who are paying a big price by having to work weekends and very long hours, resulting in a low quality of life as detailed on the article below:
Hollywood's VFX Shops: Trouble in Boom Times

There are several successful companies in our industry that have been implementing Lean principles in the way the lead their organizations.

Pixar, for example:

Here the author mentions that Pixar has been looking closely at how Toyota revolutionized the Auto manufacturing business by applying Lean principles and how they were key in developing a culture of continuous improvement which led Toyota to become a leader in its industry.

Please don´t stop reading because I mention an Auto manufacturing company which cannot relate to a creative business such as ours.

Our industry is very different but the Lean Principles and Thinking developed and implemented by Toyota during extremely tough times have been successfully applied to other knowledge work industries such as software development, game development and as mentioned, to the VFX/CGI industry as you may read in the article below.

How Pixar Fosters Collective Creativity

In the Article Ed Catmull suggests several Principles for managing a creative organization.
Most of these principles can be related to the principles found in Lean Thinking/Management.

It is funny to see how people react when you start talking about Lean and you mention Toyota.
They say: “We are a creative business not a manufacturing company.”  “We are not a factory we are creative.”

This is true but at the same time the way most of the VFX Facilities manage their Artists and Projects is by using management methodologies developed ages ago for Mass Production in Factories!  These methods don´t work for the kind of creative/knowledge work we do.  So this is a place where change could generate positive impact.

The Paper below is a great document, written by Mary Poppendieck one of the most influential experts on Lean product and software development, were she brilliantly describes Lean Thinking.  It has a bit of history on the subject and details how these principles can be applied to several industries:
Principles of Lean Thinking

Here are some other references to literature written by Lean Leaders such as:

-       Jefrey Liker  (Author of the famous book “Toyota Way”),

-       David Anderson (Author of “Kanban” a incredible book with details on how Lean can help companies mature and achieve a culture of continuous improvement),

-       Mary and Tom Poppendieck,

-       Clinton Keith (Author: Agile Game Development with Scrum)

These people have amazing real life experiences of how Lean Principles can create radical shifts in the management of complex creative/knowledge work, achieving significant results in quality, productivity, team engagement and overall improvement in several organizations in different industries.

When reading the articles on Lean Thinking, such as the ones above, it become clear how these principles could help our industry become more effective and change the way we do business.

This starts by creating positive change inside the VFX Facilities or your own department or team and from there it spreads and creates a much positive interaction with the other stakeholders involved in up and downstream processes.

In the case of the Visual Effects industry this could help us develop closer relationships between the Artist, Facilities and Studios.

We need to start collaborating and stop negotiating as in the paper written by David Anderson:

I have personally been using Lean Principles to manage my projects since 2009.  Although I only managed to scratch the surface of implementing these principles, the positive results my team and I experienced in terms of quality and productivity were enough for us to get a grasp of the power behind these principles.  Since then I have continued to study this subject more and more – day after day, reading books, participating in Workshops and implementing them on the projects I Supervise.

I am very fortunate to work in such an amazing and unique industry.
This document is my 2 cents to try and offer something in our journey to a brighter future and participate in helping improve our industry.

I hope some of this makes sense.
I love my work and want to be sure that this incredible industry continues to thrive and offer its members and other people who are dreaming of joining a great and fun future.

Best Rgds.

Francisco Lima
VFX Supervisor

Sunday, November 4, 2012

Introduction

Welcome to the "Lean Creativity" blog.  This blog will be a collection of experience stories and discussions about applying lean techniques to creative product development.

Visual FX studios, video game developers, web developers, etc are all discovering how lean practices, adopted from a variety of other industries--from software development to auto manufacturing--can be applied to the creative arts.  These practices promote agility, efficiency and, most of all, an acknowledgement of the humanity and value of artists in creation.