Analytics, Strategy, and Agriculture

Category: Agriculture

Posts specific to Agriculture related topics

The 4 Parts to a Data-Driven Farm

There’s probably no greater technology that can benefit farmers more currently, than the tools and services that allow for data collection and analysis across a farming operation. Consider how calorie counting can help folks lose weight by simply gaining better visibility over what they are eating. It’s similar having data collection across all parts of a farming operation can reveal where resources such as labor and capital are being spent at a greater degree of accuracy. This allows for cost savings and greater yields as growers move closer to precision agriculture.

Regardless of the type of crop, farming inherently has always been a data driven operation. The methods used to collect and analyze data, however, have been changing fairly rapidly in the past several years. As a result, growers have started to go from clipboards and excel spreadsheets to IoT data collection and business intelligence. Row crops have certainly led the way on automated data collection, given the large number of acres per farm compared to other types of crops. Specialty crops, however, have been catching up in the past couple of years with several new AgTech companies coming online that focus on crops such as wine grapes and tree fruit.

This has significant benefits to a grower, allowing for more focused data collection in areas such as labor cost efficiency or the yield impact of spray applications. More opportunity for farmers though, means more vendors wanting to cash in on data driven farming. This has led to several hundred new companies coming online, talking about how their platform can support better data collection and analysis.

Where to start

Before jumping into the mess of AgTech vendors though, it’s important to step identify the 4 pieces you’re going to need to modernize your data collection and analysis across your agriculture operations. This will help ensure you have a strong foundation from which to build from, if you don’t have these pieces already.

Before setting up all the other pieces of the ecosystem, my advice is to start with data analysis as the first step (even though it’s listed at the end of this post) in order to understand what you want to measure. It’s easy to incur a lot of costs quickly, if you bite off too much at once when it comes to building up a modern day data ecosystem. Having a clear set of KPIs / OKRs / metrics / etc will allow you to tie what you’re measuring to what you’re saving / gaining and get to a return on investment faster. From there, you can add to what you’ve built, and measure more as your use of data grows across the company and more people gain familiarity with the new capabilities.

Part 1) Data Collection

Recently there has been a large surge in sensors for farms that can track everything from soil moisture to pest counts. There’s two things to focus on when considering what tools to use for data collection. The first is what concentration you’re going to need the sensors for accurate data collection. The second is how friendly the sensors are to having data harvested from whatever system they’re feeding their findings into.

Most vendors offer web based solutions for showing you their data, but it’s only really useful if you’re able to extract it into a central place (such as a data warehouse). This is important because you will need to pull together individual readings over a given acre to then compare to an output metric such as yield. As for concentration, without sensors the data is likely already being collected today using manual sampling methods. It’s important, then, to consider the ROI from automated data collection at a sufficient concentration. And of course, always start with just a couple sensors to validate the technology will work for you before scaling.

Part 2) Data Consolidation (or ELT)

Once you have your data collection sorted out, and you’ve begun to measure data in an automated or semi-automated fashion, you’re going to need to get the data into a central spot, such as a data warehouse, in order to put that data to best use. In that case, you’re going to need to pick a vendor to help with this. Though there are ways to do it yourself, it requires hiring 1 or more experienced data engineers / programmers that can build and maintain the system.

For most farming operations, picking an ELT (extract-load-transform) vendor is going to be a better bet, such as FiveTran or Dell Boomi. These tools will allow you to connect to a data source, such as your accounting system or field data collection, and extract / load / transform the data into a central place which then allows you access to all of your raw data across as many systems as you’re able to connect to. This is why, when considering data collection, that you understand what vendors have capabilities such as an API which allows for data extraction.

Part 3) Data Warehousing

The next component that is foundational to being data driven, is having a central location for your data. Depending on the volume of data, you may be able to use a standard database such as MySQL or SQL Server. If the volume is large enough (1 Terabyte or more) you may need to consider a Columnar based database such as Snowflake or Azure Synapse which is designed for large data sets. When you’re storing a lot of data from sensors across your operation, you are likely going to get larger data volumes sooner than later. The key is to start with smaller data sets that are useful right away vs starting big by storing everything and having to support too much at once.

It’s also recommended to host your data in the cloud, and to get as of your ecosystem into the cloud as possible. Though you likely have data hosted locally today, which in some cases is required for business continuity, having a plan to get as much into the cloud as possible has a number of benefits.

Part 4) Data Analysis

Once you are measuring the right information, and then extracting / storing it in a central location, you need to consider what metrics you are going to track. Having 10 or so metrics from which to measure your biggest cost drivers (such as labor or parts) means you can get actionable insights faster vs guessing what might be useful to use all this data on. It’ll also help you understand what data to collect first, vs boiling the ocean and gathering all the data at once. Using a BI, or Business Intelligence tool such as Tableau or PowerBI, will allow you to point to your data warehouse and begin to construct these metrics (or KPIs as they’re often called) in order to begin building automated reporting.

It’s recommended to work with a third-party firm, or experience resource that has worked with these tools in the past to get started. But there is a ton of great resources online on getting started with a BI tool if you want to start getting your hands dirty. You can even start with just an excel or CSV file as a data “source” if you want to get started with BI / reporting prior to having everything else done. Once you have these metrics established, you can look at other capabilities under categories such as data science, AI, or Machine Learning. However, that will require specialized expertise to build solutions using these advanced methods. The good news is these capabilities have been growing over the years, so it’s a lot easier to find expertise with these skills than it used to be a couple years ago.

Next Steps

Though this is a very simplified view of a data ecosystem as there are several complicating factors to consider, this is a good 30,000 foot view of the pieces are essential in all cases of a modern data driven architecture. These should be considered when you’re looking to bring a new AgTech vendor online. Understanding where they fit, and what they’ll be contributing to is critical to ensure you don’t have a bunch of isolated (or “silo’ed”) point solutions that you aren’t able to bring together into a single set of metrics.

The next step is to learn more about each, which I’ll be covering in future blog entries. Of course, if you have any questions, feel free to reach out directly or leave a comment.

The Hidden Ingredients of a Beer

When you think of a beer, what ingredients come to mind? Water, a source of starch such as malted barley, yeast, and hops all may be on the list. Different types of beers, of course, all have different types of ingredients along with the many varieties of ingredients such as hops (around 130 varieties exist currently, for brewers to chose from).

Regardless of how it’s made though, there are several hidden ingredients in beer that you might not know about. Recently I’ve had the chance to move back to Yakima, Washington from Seattle after 15some years living and working there. I grew up in eastern Washington, about an hour east in the town of Prosser so it was in a lot of ways me coming home.

What I wasn’t aware of, though, was just how vibrant the culture of hop growing and beer making was in the valley. Did you know Washington grew 77 million pounds of hops last year, bringing in $427 million dollars and its all within driving distance to Yakima? That’s 77% of the total hops grown in the United States, on 75% of the total US hop acreage. Yakima even has shirts available on that proudly declares “We Grow Your Beer”.

It was in getting to know the folks at Bale Breaker, a craft brewery here in Yakima with a heritage in hop farming dating back into the early 1900’s that I really got to know craft beer. In so doing, those hidden ingredients that lie within each beer became evident.

So what are those hidden ingredients?

The first hidden ingredient is community

If there’s one thing you can pick up on walking into any tasting room is the close friendships that form between the patrons, and employees of a craft brewery. It’s really community that makes beer something that brings folks together, to share in good times and bad. You don’t have to know a brewer for very long before you come to feel like family. Beer, I’ve learned, is not only is great for bringing friends together, but helping make new friends at the same time.

The second hidden ingredient is love

There’s something special about hearing a brewer describe the beer they make. It’s the passion and pride they have for a job well done, combined with a love for making something that others can enjoy. Not only does a brewer, along with the team that supports them, love what they do but they love seeing people partake and are always willing to share how and what they do to anyone that asks. It’s a love and passion seen rarely in the office place and is evident anytime you encounter someone that works in the craft brew industry.

The third hidden ingredient is legacy

In learning about the history of beer, I discovered that there is early evidence of beer from a 3,900-year-old Sumerian poem honoring Ninkasi, the patron goddess of brewing which contains the oldest surviving beer recipe. Monks further refined the concept of brewing dating back to the 16th century, where people around the world have been refining and experimenting since then. In the Yakima Valley, Leota Mae moved to Yakima in 1932 and began cultivating hops on land still farmed by her family today (some of those Smiths went onto start Bale Breaker located on lot 41 of that very same farm). Multi-generation families grow hops all throughout the Yakima valley, with several more families growing other ingredients that make beer great. It’s a profession chock full of legacy, with more history added with each crop year.

The fourth hidden ingredient is creativity, along with innovation

Though there’s several more “hidden ingredients” I could chose from, the last one I’ll talk about is creativity combined with innovation. There’s nothing that demonstrates rapid prototyping, experimentation, and feedback better than beer. Bale Breaker has an “imagination station” where they are making small batches trying out new kinds of recipes and collaborations each day. They share it via their tasting room for instant feedback and aren’t afraid to totally fall on their faces while cranking out new experiments. The ones that make it, get their own can and sold all across the pacific northwest while the rest are shelved for the time being till they’re brought out to experiment with once again. Some experiments are seasonal, some are collaborations with other folks in the beer industry, and some are just for fun. It’s evident though, in how Bale Breaker goes about inventing new flavors though that they truly understand the importance of innovation and creativity to keep a business thriving.

At the end of the day when you add all this up, it comes down to the fact that beer is more than just the beverage. It’s the hard work, passion, and community that comes together crafting each and every type of beer that makes it greater than the sum of its parts. And that alone, is worth spending time getting to know and enjoy.

So head over to Bale Breaker if you’re ever in Yakima, or any of the other amazing craft breweries nearby. Or if you’re not nearby, you’re no doubt within driving distance to someone’s passion and hard work ready on tap and available to share with you and your friends.

Go smell, sip, and enjoy! And when you do, think about those hidden ingredients that truly make beer more than just a drink.

© 2020

Theme by Anders NorenUp ↑