• Digitalisation of the agrifood sector: what does Twitter tell us?

    catalanspanish

    Technology is advancing at a frenetic pace and offers the agrifood chain a large number of opportunities to make its production more efficient and sustainable. Moreover, the arrival of COVID-19 has shown that the most digitalised companies were able to continue their activities more readily than the rest. In this article we examine the degree of popularity of the different digital technologies used in the primary sector and agrifood industry based on a text analysis of over 2 million tweets on Twitter. All these technologies are essential to create a connected ecosystem that will make up the Food Chain 4.0 of the future.

    Plantilla

    plantilla_article_vs05

    Etiquetas
    Miniatura
    Área geográfica

    The unexpected arrival of the pandemic has shown that the most digitalised companies were more prepared to adapt to the new situation and were able to continue to operate much more smoothly than the rest. There is no doubt that, in this new environment, the digital transformation of companies is now unavoidable in order to boost their competitiveness.

    Big data, robotics, the internet of things and blockchain are just some examples of the new digital technologies gradually being adapted by firms, particularly in the agrifood sector. Technology is advancing at a frenetic pace and is offering the agrifood chain a large number of opportunities to produce more efficiently and sustainably. However, statistical information on the degree to which such technologies have been taken up, and the most comprehensive official statistical source1, does not provide information on the primary sector. Below we present a novel analysis of the «popularity»  of new digital technologies in the agrifood sector based on data from Twitter.

    • 1. Survey on the use of information and communication technologies (ICT) and e-commerce in companies, compiled by the National Statistics Institute.
    Twitter as a source of information to detect future trends

    Data from Twitter can be extremely valuable in detecting new trends as it allows us to analyse the popularity of certain terms according to how frequently they appear in tweets. However, it is true that «talking about something» is not the same as successfully implementing the various digital technologies in a company's recurring operations. For this reason the results presented below should be interpreted simply as an indication of new trends that may be taking root in agrifood companies.

    Data from Twitter allow us to analyse how popular the different digital technologies

    are in the agrifood sector according to how often they are mentioned in tweets.

    For this study, data was processed from over 24 million tweets sent by individual users and digital media during the period 2017-2019. Among these, 2 million corresponded to the agrifood sector. Using natural language processing techniques, the tweets were categorised according to mentions of different digital technologies and to the business sector.2 The key to obtaining relevant data from social media is to first define «seed» words or phrases to identify texts corresponding to each of the business sectors, as well as «seed» words or phrases related to the different digital technologies of interest.3 Using a machine-learning algorithm, other words and phrases related to the concept in question that were not initially included were also identified, thus broadening the spectrum of texts analysed. At this stage, it is important to carefully screen for polysemous words (i.e. those that have more than one meaning, such as the word «reserva» in Spanish, which can be used to refer to a hotel booking as well as an aged wine).

    • 2. This analysis was carried out in collaboration with Citibeats, a company specialising in unstructured natural language processing.
    • 3. For example, the «seed» woods and phrases used to identify big data were: analytics, arquitectura de sistemas (system architecture), data mining, database, inteligencia empresarial (business intelligence), Python and SQL, among others (as well as the term big data per se).
    What is the degree of digitalisation of the agrifood sector according to Twitter?

    To assess the agrifood sector's degree of digitalisation according to data from Twitter, we first need to know how common tweets about digitalisation are in other business sectors. The most digitalised industry according to our analysis is the information and communication technologies (ICT) sector: 3.2% of the sector's tweets contain terms related to digitalisation, a result that is not surprising given the very nature of the industry. Next comes finance and insurance with 2.7% of the tweets.

    This percentage is obviously lower in the primary sector at 0.6% but it is similar to the 0.7% for professional, scientific and technical activities. In the case of the agrifood industry, the percentage of tweets on digitalisation is only 0.3%, very close to the basic manufacturing sector (which includes the textile, wood, paper and graphic arts industries), with the lowest percentage among the sectors analysed, 0.2%.

    p 26
    Which digital technologies are most popular in the agrifood sector according to Twitter?

    The wealth of data obtained from Twitter allow us to identify the most popular digital tools in each business sector according to how frequently they are mentioned in the tweets examined. According to our analysis, a large proportion of the primary sector's tweets about digitalisation tend to include issues related to big data (45% of all tweets about digitalisation). One clear example of the application of big data in the sector can be found in «precision agriculture» techniques which require large amounts of data to be analysed to optimise decisions and thereby increase production and, in turn, ensure sustainability. These techniques are used, for instance, to calculate the irrigation requirements of crops by taking into account climatic conditions (sunlight, wind, temperature and relative humidity) and crop characteristics (species, state of development, planting density, etc.). To carry out this calculation, real-time updated meteorological data, a large computing capacity and fast data transmission speeds are all required for an automatic irrigation system to be properly adjusted. This technology helps to use water more efficiently, a highly relevant aspect in areas with a Mediterranean climate that are extremely vulnerable to climate change and where water is in short supply.

    Big data, the internet of things and robotics are the most popular technologies in the primary sector,

    indispensable for advancing the application of precision agriculture techniques and smart automated farming.

    Other popular technologies in the primary sector are the internet of things (16% of tweets) and robotics, including drones (10% of tweets). The new digital technologies promise to revolutionise the field of agriculture and stockbreeding by the middle of this century, the same as the mechanisation of farming in the xxi century. Agricultural Machinery 4.0 (which is closer to the robots in science fiction films than to the tractors we are used to seeing on all farms in the country) helps to increase productivity whilst also improving working conditions in the field. This trend towards more automated agricultural tasks has become stronger in the wake of the coronavirus pandemic, as the difficulty in recruiting seasonal workers due to international mobility restrictions has led to increased interest in robotics and agricultural automation. In fact, companies that manufacture robots for agriculture have seen a sharp increase in orders, such as robots that pick strawberries while removing mould with ultraviolet light.14 

    The use of drones warrants particular attention as this has grown exponentially in recent years and applications are increasingly widespread: from the early detection of pests and the aerial inspection of large areas of crops to locating wild boar with heat-sensitive cameras to prevent the spread of African swine fever to domestic pigs.5

    • 4. See Financial Times Agritech «Farm robots given Covid-19 boost», 30 August 2020.
    • 5. See http://www.catedragrobank.udl.cat/es/actualidad/drones-contra-jabalies

    The popularity of various digital technologies in the agrifood sector

    p 28

    Blockchain is the technology that stands out most in the food sector (30% of the total number of tweets on the sector's digitalisation) and this comes as no surprise as it has many different applications for the food and beverage industry. Producing a chain of unalterable, reliable records, blockchain makes it possible to guarantee the complete traceability of products throughout all the links in the food chain. Simply scanning a QR code provides access to all the data regarding the origin, production method, veterinary treatments received, ingredients used, etc. A large number of agrifood companies are already experimenting with blockchain as it offers clear benefits in terms of transparency regarding origin, product quality and food safety, aspects that are increasingly valued by consumers. Blockchain technology is also being used to limit food waste, another essential challenge for the sector.

    Blockchain enables the digital verification of food products,

    making them traceable throughout the links in the food chain.

    Compared with other sectors, which tools are particularly significant for the agrifood industry?

    There are some digital technologies that are not very popular across all economic sectors, perhaps because they have a more limited or specific range of application. These are technologies that, despite having a low percentage of tweets in absolute terms according to our study, may be relatively popular for a particular sector compared with the rest.

    To detect such cases, we have calculated a new metric, namely a concentration index which takes into account the relative popularity of technologies in a sector compared with the rest of the sectors.6 By using this methodology, we have found that the primary sector continues to stand out in terms of big data. Specifically, the primary sector concentrates 9.2% of the total number of tweets mentioning big data made by all sectors, a much larger proportion than the 3.1% share of primary sector tweets out of the total number of tweets analysed (as can be seen in the following table, in this case the concentration index is 3). We have also determined that the sector is particularly interested in the internet of things, as already mentioned, but have discovered that nanotechnology is also a relatively popular technology in the primary sector. In other words, although only 3.8% of the tweets in the primary sector deal with nanotechnology, this percentage is high compared with the 1.7% share of nanotechnology tweets out of the total (in other words, this technology is not very popular in general across all sectors but is slightly more popular in the primary sector than the others). This find is not surprising since genetic engineering is one of the fields in which technology has advanced most in order to boost crop yields. For example, by optimising the yield of vines it is possible to develop plants that are much more resistant to extreme weather conditions and pests.

    • 6. The concentration index is calculated as the ratio between (1) the percentage of tweets related to a particular technology and sector out of the total tweets for this technology, and (2) the percentage of tweets by a sector out of the total tweets of all sectors. Values above 1 indicate the technology is relatively more popular in that sector.

    Concentration index for tweets related to each technology in comparison with the other sectors

    p 29

    Finally, virtual and augmented reality is also a relatively popular technology in
    the agrifood industry.
    Specifically, the agrifood industry concentrates 6.2% of the total virtual and augmented reality tweets made by all sectors, a percentage that more than doubles the 2.5% share of primary sector tweets out of the total number of tweets analysed (the concentration index is equal to 2.5 in this case). This technology uses virtual environments (virtual reality) or incorporates virtual elements into reality (augmented reality) that provide additional knowledge and data that can be used to optimise processes. At first it may be surprising that this technology is relatively popular in the agrifood industry but its uses are spreading as the industry implements digital technologies in its production processes, in the so-called Industry 4.0. One specific example of how this technology is used is in repairing breakdowns. When a fault occurs, operators can use augmented reality goggles to follow the steps contained in virtual instruction manuals that are projected onto the lens to help resolve the incident. The glasses recognise the different parts of the machine and visually indicate to operators where they should act to solve the specific problem.

    There are numerous examples of new digital technologies being applied in the agrifood sector. We are witnessing a revolution that is destined to transform the different links in the food chain: from the exploitation of data and the use of drones to make harvesting more efficient to implementing blockchain technology to improve the traceability of the final products that reach our homes. In short, the future will bring us the Food Chain 4.0, a totally connected ecosystem from the field to the table.

    Destacado Economia y Mercados
    Desactivado
    Destacado Analisis Sectorial
    Desactivado
    Destacado Área Geográfica
    Desactivado
  • e-commerce: several year’s progress made in just a few months

    catalanspanish

    The pandemic has inevitably brought about major changes in our consumption habits. Faced with the impossibility of going to a store in person, online shopping channels have gained a lot of share in 2020. According to an analysis of CaixaBank’s internal data, this growth has not only been significant but also widespread among companies of different sizes and sectors, and has encouraged many of them to use e-commerce as a sales channel for the very first time.

    Plantilla

    plantilla_article_vs05

    Temática
    Etiquetas
    Miniatura
    Área geográfica
    The huge growth in e-commerce after the outbreak of the pandemic

    The harsh mobility restrictions imposed to combat the spread of COVID-19 have undoubtedly dealt a severe blow to the Spanish economy but they have also speeded up some of the changes we had already been observing. One of the changes seeing the greatest growth, and also which we have been monitoring the most, is the adoption of e-commerce by retailers. Given the mobility restrictions and social distancing, online sales are providing a boost for the retail sector that has helped to avoid an even more complex economic situation during the pandemic.

    To analyse the progress of online sales, we have used the consumption indicator compiled from CaixaBank’s internal data, evaluating the trend in retail without the trade in essential goods, which perform very differently to the rest of retail trade.11 As can be seen in the chart below, e-commerce sales have performed very well since the start of the pandemic. Between the months of April and May 2020, when mobility was restricted the most, e-commerce spending achieved triple-digit growth, reaching spending volumes only surpassed in the week of Black Friday in recent years. This growth rate moderated as restrictions were eased and people could once again make face-to-face purchases. Nevertheless, the growth rates have consistently remained above 50% compared to 2019, except at very specific moments.

    • 11. We have excluded food and pharmacy sales from the analysis since the effect of the restrictions on the consumption of these types of goods was the opposite of that observed for trade in non-essential goods during the early part of the pandemic.

    CaixaBank retail consumption indicator1

    Variation compared to the baseline (%)2

    CaixaBank retail consumption indicator

    The trend described for e-commerce is in clear contrast to the performance of face-to-face sales which, as can be seen from the chart, fell sharply during the first state of emergency and, to a lesser extent, during the second and third waves of COVID-19 in November 2020 and February 2021, respectively. In 2020 as a whole, face-to-face retail spending fell by 23% compared to 2019, while e-commerce grew by 69% year-on-year. As a result, the growth in online sales cushioned the impact on the sector’s turnover, down by 15%.

    Democratic growth in internet sales

    One question that should be asked is what type of commerce has been able to benefit from this growth in online sales. Switching to selling online or expanding existing e-commerce channels entails significant investment in digitisation, representing a barrier for smaller businesses, especially those having to adopt this channel for the very first time. Nevertheless, according to an analysis of CaixaBank’s internal data, the growth in e-commerce has been widespread, observed in both large and small companies, as well as in companies with e-commerce experience and also new entrants.

    According to an analysis of CaixaBank’s internal data,

    the growth in e-commerce has been widespread, observed in both large and small companies, as well as in experienced companies and new entrants

    As the following chart shows, as of May 2020 the contribution made by new entrants to the growth in e-commerce sales increased steadily, reaching 30% of the total. However, after the second state of emergency was announced on 25 October 2020, this upward trend ended. This is probably because, in events such as Black Friday and the Christmas season, the most consolidated e-commerce retailers once again captured the bulk of online sales. However, the contribution made to e-commerce growth by new entrants was very high in 2020 as a whole, revealing that this shift to internet sales has also occurred in stores that were not previously online.

    Contribution to retail e-commerce growth by new entrants

    Last actualization: 07 July 2021 - 15:47

    If we look at the dynamics of e-commerce by company size, we can observe two different stages. First, during the months of the first state of emergency, large companies made up the bulk of e-commerce growth. Small businesses found it more difficult to react immediately and many had to wait until they were able to open in person in order to start adapting to e-commerce sales.

    During the months of the first state of emergency,

    large companies made up the bulk of e-commerce growth. Small businesses have taken longer to react

    25

    From the end of June, coinciding with the end of the state of emergency, the dynamics of e-commerce began to change in favour of smaller businesses. Specifically, from that moment on, the possibility of opening their doors made it easier for many small businesses to adapt to the online sales channel. As a result, in July and August online sales by smaller companies generated about half the sector’s total growth in e-commerce.

    CaixaBank retail e-commerce indicator1

    Contribution to year-on-year change (pp)

    CaixaBank retail e-commerce indicator
    Structural change

    Internal CaixaBank data also suggest that the increase in online sales is not concentrated within a few types of trade; in fact quite the opposite. All retail categories have posted appreciable growth during 2020, although we expect to see e-commerce growth moderating in favour of greater on-site spending following the lifting of restrictions.

    It is therefore interesting to estimate to what extent the growth in e-commerce is here to stay. To this end, the chart below shows the trend in the share of online purchases as a percentage of total purchases in the different branches of retail activity. As can be seen, the share of e-commerce picked up strongly in 2020 in all branches. However, if we compare the trend of recent years with the record of March 2021, a month with notable restrictions but not particularly hard on retail trade, we can see there are some branches of activity (bookshops and stationers, as well as textiles) where the share of face-to-face consumption has returned to normal. On the other hand, for the rest of the branches of activity, part of the extraordinary gains made in 2020 was still visible in March 2021, to some extent suggesting a possible change in consumption patterns.

    Share of e-commerce in total sales

    Last actualization: 07 July 2021 - 15:48
    It is too early to judge how much of this change will be structural and how much will dissipate once we get over the health crisis.

     Face-to-face consumption is sure to remain one of the main supports for retail trade

    In conclusion, e-commerce has grown considerably after the emergence of COVID-19. This growth, moreover, has been «democratic» since both large and small companies (although the latter took a little longer) have taken advantage of the boost provided by the mobility restrictions to online consumption. It has also been a very steep learning curve, so that new entrants to e-commerce were behind much of the growth in 2020.

    However, it is too early to judge how much of this change will be structural and how much will dissipate once we get over the health crisis. Face-to-face consumption is sure to remain one of the main supports for retail trade. Nevertheless, it is difficult to see a future for retail without the sector committing clearly and strongly to digitising its sales channels, enabling many small businesses to access a much larger and more diversified market and consumers to access a market with a much wider range on offer.

    27
    Destacado Economia y Mercados
    Desactivado
    Destacado Analisis Sectorial
    Desactivado
    Destacado Área Geográfica
    Activado

Public policies for the diffusion of technology

Public policies play a key role in helping technological advances to emerge and spread throughout the economy. In this article we address the dissemination of technology and the role of public policies in this process.

Content available in
NGEU y bandera de la UE
The difficulties in disseminating technology

If it were easy to copy the technology of our neighbours or competitors, there would be little technological difference between countries, or between regions within a country... let alone between companies within the same country and region! Yet, in reality, only a few countries and companies develop new technologies. In addition to these differences in creation, the ability of third countries to adopt new technologies is also highly uneven (see first chart).

Readiness for frontier technologies index

The spread of technology is by no means simple, neither between countries nor within countries themselves. According to Ricardo Hausmann, director of the Center for International Development at Harvard University, technology is composed of three types of knowledge: that of the tools and materials; the codes, manuals and instructions; and the tacit or practical knowledge (know-how) possessed by the professionals who have developed or who use the technology itself. This last element is the main stumbling block for the spread of technology.

As Hausmann explains, the tools and materials that make up a technology can be acquired; the codes can be understood with a sufficient educational base (through what is defined as explicit knowledge); but know-how can only be obtained through repeated face-to-face interaction with the technology itself (learning by doing) and this, inevitably, means it takes time.

Moreover, in modern societies this know-how is on such a vast scale that it cannot be covered by a single individual, nor by a handful of individuals, hence it is dispersed among large groups which are organised in an interconnected, modular way. Acquiring a new technology thus also requires a particular organisational fabric (an added hurdle for its dissemination).

How public policies can help... and what we find in Spain’s Recovery and Resilience Plan (RRP)

In the development and dissemination of future technologies, it is firstly necessary to have adequate digital infrastructures (these would be the aforementioned «tools» or «materials»). In this sphere, Spain is in a relatively strong position compared to the EU average: it has one of the widest deployments of very high capacity networks, covering 89% of households in 2019, compared to 44% across the EU on average and 45% in 2015 in Spain.1

Despite this good starting point, the RRP emphasises the use of such digital tools by SMEs, whose small size often makes it difficult for them to adopt digital technologies. After all, having the tools available is not the same as making good use of them. The SME Support Plan (Component 13 of the RRP), with a significant investment planned (4,894 million euros), will play an essential role in facilitating this adoption. This component aims to promote the use of digital solutions in these smaller companies through grants, the creation of innovative digital hubs and training.

This latter element (training) is necessary to improve explicit knowledge on new technologies (the second defining component of technology according to Hausmann). In fact, in addition to this digital training focused on SMEs, the Spanish Plan will also invest in digital training for Spanish society as a whole, through the National Digital Skills Plan (Component 19 of the RRP). In other words, these are investments that will educate us on how to read and understand the «manuals» associated with new technologies.

Up to this point, however, we have only talked about policies and investments that affect the first two defining components of technologies (tools and explicit knowledge), but not the third (know-how), which is precisely the one that makes the dissemination of technology more difficult.

Attracting talent, combined with the mobility of this talent within societies, are essential ways for encouraging the flow of know-how and, therefore, the flow of new technologies. As Ricardo Hausmann often stresses, it is easier and quicker to move brains with know-how than it is to fill them with this know-how.

Promoting innovative projects is certainly one way to attract talent from around the world. In this regard, the National Artificial Intelligence Strategy, which is Component 16 of the Plan, provides a clear path for attracting talent. However, as argued by EsadeEcPol,2 it would be important to complement these efforts in order to achieve the establishment within Spain of different European research sites such as the European Centre for Industrial Competition or Cybersecurity, or to go further with the proposed changes to research careers in order to give new hires with external assessments (tenure track) greater stability and career opportunities.

More generally, attracting talent is aided by certain labour market policies and institutions. The economic progress of countries depends heavily on the evolution of a small group of companies that grow at rates far above the average (referred to as gazelles). Labour policies, among others, can make it difficult to reallocate know-how between companies. Thus, for example, the duality that exists in Spain’s labour market, as a consequence of various of these policies, means that the most senior workers with a high degree of know-how are more likely to remain in jobs in low-growth companies rather than take the leap to join companies which have an enormous growth potential but are just taking off. Similarly, many of these workers are entrepreneurs with the potential to found firms that could well become the country’s gazelles of the future, but again, they do not take the leap to found them. On the other hand, the most entrepreneurial companies also suffer this duality, as they would prefer a more flexible labour market in the face of the risk of their project not living up to expectations. In this regard, reforms that help to reduce this duality, as proposed in the RRP, are clearly a positive development. Furthermore, establishing individual workers’ funds which can be used in the event of dismissal or a change of company (like the Austrian backpack) would help to prevent talent (linked to know-how) from being retained in low-growth companies for fear of losing the rights acquired after a long employment relationship.

Finally, the dissemination of technology is easier when similar or related technologies exist in the country that wants to adopt the new technology in question. This is especially true in the case of complex technologies, since they often require high doses of know-how and particular organisational structures (the idea of knowledge collectivity is key in such cases). The presence of related technologies will mean that there are many workers with know-how of elements similar to the new technology. Moreover, the organisation of the related technology could often be easily converted to meet the new technological needs. In this regard, it is important that public institutions, in their task of distributing and coordinating NGEU funds, make a good diagnosis of the productive structure and technological status of Spain’s various sectors in order to help drive the most suitable technological leaps.

  • 1. See the article «Spain in the digital race» in the Dossier of the MR03/2021 for more details, as well as the article «NGEU: an international comparison of the recovery plans and their investments in new technologies» in this same Dossier.
  • 2. For a critical analysis of some of the elements of the Plan, see EsadeEcPol Brief #9 (April 2021) «Reformas, gobernanza y capital humano: las grandes debilidades del plan de recuperación» (article available in Spanish).
Technology and policie s for its dissemination
Etiquetas