{"id":16962,"date":"2024-04-01T16:52:52","date_gmt":"2024-04-01T14:52:52","guid":{"rendered":"https:\/\/www.rnw.media\/?post_type=news&#038;p=16962"},"modified":"2025-05-28T13:46:22","modified_gmt":"2025-05-28T13:46:22","slug":"how-to-run-content-strategy-experiments-to-boost-traction","status":"publish","type":"news","link":"https:\/\/www.rnw.media\/index.php\/news\/how-to-run-content-strategy-experiments-to-boost-traction\/","title":{"rendered":"How to run content strategy experiments to boost traction?"},"content":{"rendered":"<p class=\"p5\">By Tom Greenwood<\/p>\n<p class=\"p5\">Move as many people as possible with your digital content.<\/p>\n<p class=\"p6\"><b>Experimentation guarantees impact<\/b><\/p>\n<p class=\"p5\">Experimentation is everything in digital media. Strategy is only ever our best guess. Maybe it will work, maybe it won\u2019t, but with digital media we get instant feedback in the data. We can see if it\u2019s working or not, and we can continually tweak things to try to make it work better.<\/p>\n<p class=\"p5\">Those tweaks are experiments. Again, we don&#8217;t know if they&#8217;ll definitely work or not, but if we keep making tweaks and checking to see how our audience reacts, we keep learning what our audience wants from us. It\u2019s the best way to understand who we need to be to create impact in the world.<\/p>\n<p class=\"p6\"><b>So how does it work?<\/b><\/p>\n<p class=\"p5\">Let\u2019s take an example from our own content last year. We collaborated on a really cool research project that showed how Meta&#8217;s anti-porn policy prevents young people from getting important information on sexual and reproductive health. It was covered by the New York Times and it got 100+ million reads.<\/p>\n<figure id=\"attachment_16963\" aria-describedby=\"caption-attachment-16963\" style=\"width: 660px\" class=\"wp-caption alignnone\"><img fetchpriority=\"high\" decoding=\"async\" class=\"size-medium wp-image-16963\" src=\"https:\/\/www.rnw.media\/wp-content\/uploads\/2024\/10\/65ff39a1346c39d7414d3d33_fb-ad-original-660x404.png\" alt=\"Meta censor SRHR content\" width=\"660\" height=\"404\" \/><figcaption id=\"caption-attachment-16963\" class=\"wp-caption-text\">Meta censor SRHR content ads<\/figcaption><\/figure>\n<p class=\"p6\"><b>Start with a hypothesis<\/b><\/p>\n<p class=\"p5\">Our own facebook post promoting it got 48 engagements and 2 reposts. That\u2019s not too bad, especially relative to our usual levels of engagement at the time. But maybe it could have done better. Experimentation is how we find out.<\/p>\n<p class=\"p5\">Experiments always start with a hypothesis: \u201cIf we do X, then Y is probably going to happen as a result.\u201d So let\u2019s take a look at the original post and figure out what stopped it from engaging more people. We can&#8217;t know exactly but we can take a guess. And then that guess becomes our experiment hypothesis, and we can design an experiment to either prove or disprove it. Let\u2019s start with this:<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-medium wp-image-16964 lazyload\" data-src=\"https:\/\/www.rnw.media\/wp-content\/uploads\/2024\/10\/6601b3176d24a2c18161fa5c_FB-post-comments-660x457.png\" alt=\"\" width=\"660\" height=\"457\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 660px; --smush-placeholder-aspect-ratio: 660\/457;\" \/><\/p>\n<p class=\"p6\"><b>Our hypothesis<\/b><\/p>\n<p class=\"p5\">Overall though, we&#8217;re guessing the problem (if there was one) was probably that this didn&#8217;t connect with our audience&#8217;s current experience. The big headline on the NYT article is about Facebook ads being rejected, and that&#8217;s not going to jump out at people unless they work in social media marketing. It didn\u2019t spark an emotion either \u2013 unless you already know about this issue (and feel strongly about it) there&#8217;s not enough in the NYT headline to make you care. And as we all know, emotion means everything on social media.<\/p>\n<p class=\"p5\">So there\u2019s lots to test there. If we were purists, we\u2019d only test one variable at a time, but that\u2019s boring, and we\u2019re smart enough to work out what actually makes the difference. And if it\u2019s still unclear further down the line, we can always untangle it with more testing. So let\u2019s start again.<\/p>\n<p class=\"p6\"><b>Always audience first<\/b><\/p>\n<p class=\"p5\">Successful content always always always starts with the audience. Our goal is to move people \u2013 as many as possible if we want to create social impact. So how do we frame this in a way that people want to engage with? Well, first of all, who could be interested in it? Who has a need for it? Whose lives is it relevant to? 3 clear audience segments spring jump out right away.<\/p>\n<ol>\n<li class=\"p6\"><b>Young people<\/b>\u2013 for obvious reasons, they need information about sexual health issues. This directly actually affects them<\/li>\n<li class=\"p6\"><b>Parents<\/b>\u2013 they want the best for their kids (obvs), and good info is essential for health<\/li>\n<li class=\"p6\"><b>Current audience<\/b>\u2013 people who are interested in media, tech, society and young people<\/li>\n<\/ol>\n<p class=\"p5\">So what we&#8217;ll do is one version for young people, and one version for parents and we&#8217;ll target those two versions PLUS the original version at all three audiences.<\/p>\n<p class=\"p6\"><b>Content for young people<\/b><\/p>\n<p class=\"p5\">Our first question is, what is this giving them? Why should they click on it? They already know sex is censored on insta, so that&#8217;s nothing new. Nothing new = no point in clicking. So what can we give them that&#8217;s worth anything?<\/p>\n<p class=\"p6\"><b>How we add value<\/b><\/p>\n<p class=\"p5\">Maybe we can give them a new perspective. Maybe we can help them express their frustration at being patronized and talked down to. And if they never saw the harm caused by platform prudishness before, then maybe we can add something of real value to their understanding.<\/p>\n<p class=\"p6\"><b>Talking their language<\/b><\/p>\n<p class=\"p5\">Next question, how do we make the visual and the copy meet our audience where its at? How do we talk their language, and add to their conversation (and not butt in with something that&#8217;s irrelevant or old news)? Above all, how can we be interesting for them? (Our assumption right now seems to be that our audiences want academic, emotionless language. That&#8217;s our unspoken hypothesis, but let&#8217;s find out if it&#8217;s true.).<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-medium wp-image-16965 lazyload\" data-src=\"https:\/\/www.rnw.media\/wp-content\/uploads\/2024\/10\/660c87668018f2659210115e_meta-censorship-teenagers-FINAL-660x606.png\" alt=\"\" width=\"660\" height=\"606\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 660px; --smush-placeholder-aspect-ratio: 660\/606;\" \/><\/p>\n<p class=\"p6\"><b>Content for parents<\/b><\/p>\n<p class=\"p5\">Now let&#8217;s redo it for those young people&#8217;s parents (or just anyone who cares about young people and wants the best for them; anyone who prioritizes young people&#8217;s mental and sexual health over tradition or archaic ideas of etiquette, in other words).<\/p>\n<p class=\"p6\"><b>Motivating attention<\/b><\/p>\n<p class=\"p5\">Let&#8217;s grab their attention. Let&#8217;s show them how what they might have thought, might not be the way it actually is. People like to learn new things, especially if they don&#8217;t think they get it yet, or if there&#8217;s something they might be missing. If it\u2019s about what&#8217;s good for their kids, then it&#8217;s a must read.<\/p>\n<p class=\"p6\"><b>Splitting the audience?<\/b><\/p>\n<p class=\"p5\">Oh and by the way. Does splitting the audience here matter? No, because the promise is the same for all the audiences. If they&#8217;re interested in this \u2013 if their interested in society, and if they&#8217;re motivated by prosocial causes, then they could get value from the rest of our content too, and that means they&#8217;re less likely to become dead weight (followers that never interact again and so drive our algorithmic ranking down).<\/p>\n<p><img decoding=\"async\" class=\"alignnone size-medium wp-image-16966 lazyload\" data-src=\"https:\/\/www.rnw.media\/wp-content\/uploads\/2024\/10\/660c873c26f7646ee6d9bcb9_meta-censorship-adults-FINAL-660x722.png\" alt=\"\" width=\"660\" height=\"722\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 660px; --smush-placeholder-aspect-ratio: 660\/722;\" \/><\/p>\n<p class=\"p7\"><b>A\/B testing<\/b><\/p>\n<p class=\"p9\">Here&#8217;s how we do it. We take our original, let&#8217;s call it A. And we take our new version, let&#8217;s call it B. And we show the different versions randomly to different social media users and see which one gets more clicks. So, basically, A\/B testing is trial and error, but you get data to show you what&#8217;s working or not.<\/p>\n<figure id=\"attachment_16967\" aria-describedby=\"caption-attachment-16967\" style=\"width: 660px\" class=\"wp-caption alignnone\"><img decoding=\"async\" class=\"size-medium wp-image-16967 lazyload\" data-src=\"https:\/\/www.rnw.media\/wp-content\/uploads\/2024\/10\/Screenshot-2024-10-16-at-16.44.27-660x442.png\" alt=\"Content AB testing\" width=\"660\" height=\"442\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 660px; --smush-placeholder-aspect-ratio: 660\/442;\" \/><figcaption id=\"caption-attachment-16967\" class=\"wp-caption-text\">Content AB testing<\/figcaption><\/figure>\n<p class=\"p6\"><b>Testing moves people<\/b><\/p>\n<p class=\"p5\">Testing is the way to make sure that we&#8217;re really moving as many people as we can. Literally anything can be tested to see if it can be made more effective. We can test different audiences, designs (what makes people click more), writing styles, video editing styes, lengths, depths. We can test the intro, test first person or third person perspectives, test colorful storytelling vs dry factual\u2013 the list is as long as our list of creative choices when we&#8217;re producing content<\/p>\n<p class=\"p5\">Today, there&#8217;s not one major company or media outlet \u2013 from Nike to the New York Times \u2013 that&#8217;s not using experimentation and A\/B testing as a major part of their business strategy. Why just choose a web design you think looks nice when you can choose the design that definitely drives the most clicks or the most engagement? Experimentation is how we get answers.<\/p>\n<p class=\"p5\">And let&#8217;s be honest, we never look at the numbers and say, &#8220;ok, that&#8217;s enough.&#8221; Because our opponents, the Andrew Tates and the Vladimir Putins of the world never stop either. We&#8217;re in a battle of ideas, and experimentation and data analysis are how we win.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Digital media impact is about experimenting to discover how your content connects with the people you need to move. How to run content strategy experiments to grow engagement? Move as many people as possible with your digital content.<\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"closed","ping_status":"closed","template":"","format":"standard","meta":{"_acf_changed":false},"tags":[44],"class_list":["post-16962","news","type-news","status-publish","format-standard","hentry","tag-media-viability"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.rnw.media\/index.php\/wp-json\/wp\/v2\/news\/16962","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rnw.media\/index.php\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/www.rnw.media\/index.php\/wp-json\/wp\/v2\/types\/news"}],"author":[{"embeddable":true,"href":"https:\/\/www.rnw.media\/index.php\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rnw.media\/index.php\/wp-json\/wp\/v2\/comments?post=16962"}],"wp:attachment":[{"href":"https:\/\/www.rnw.media\/index.php\/wp-json\/wp\/v2\/media?parent=16962"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rnw.media\/index.php\/wp-json\/wp\/v2\/tags?post=16962"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}