Methodological Approach for a Study on Urban Retail Trade in the Belle Époque
Introduction
In August 1902 the British newspaper The Times inserted an article announcing “The passing of the grocer” as a result of a crisis in the small retail trade that apparently had bankrupted more than 900 stores (Winstanley 1983). Across the Atlantic, Canada’s shopkeepers faced a crisis equally significant, with overabundance of shops and a lot of bankruptcies (Monod 1996). The same happened in continental European cities like Paris or Milan, in the final decades of the nineteenth century (Nord 1986; Morris 1993). Much of what happened this time was the result of an demographic growth in the cities in the nineteenth century that almost everywhere would have important consequences in the reorganization of urban space, leading to changes in their economic and social geography. Lisbon was no exception and the city’s retail trade, after a phase of growth in the 1880s, faced a crisis in the last ten years of the century (Alves 2012). This occurred while the city was transformed, witnessing an expansion into new urban areas to accommodate an increasing volume of inhabitants.
Through the analysis of the geographical distribution of Lisbon’s retail trade, between 1890 and 1910, it is possible to verify the impact of this crisis on the way small businessmen apprehended the urban space, as well as the opportunities and risks that those changes could represent to them. This is a truly collaborative study, that is grateful to 35 history students for their work and enthusiasm! It is based on a very detailed information about the localization and characteristics of every single shop in the city streets, gathered from fiscal sources in the municipal archives (around sixteenth thousand records for each of the three years, 1890, 1900 and 1910) and analyzed through the use of spatial analysis tools. This volume of information and the potential introduced by a Digital Humanities / Spatial Humanities approach, brings in methodological challenges regarding the digitization and geocoding process of several thousands of records, as well as opens new research possibilities and new research questions, namely: about the role of women in the retail trade business, since previous work based on smaller sets of data analyzed with traditional qualitative methods had misrepresented or even ignored gender issues in the retail business (Alves 2012); or about the influence of the dwelling rents in determining changes in the social space of a city in the Belle Époque, only possible by the digital analysis of a very large, temporal and geographical encompassing amount of data for all the city.
Challenges and framework
In terms of the methodology two were the challenges we faced in two distinct stages of research, data collection and its georeferencing.
The first challenge relates to the difficulty in scanning a volume of data of this nature, only available on archive, with no available funding to carry out a project of mass digitization of the original tax records. This was associated with the fact that all sources are handwritten, drawn up by several employees, with equally different handwritings, which would make it impossible, given the current state of handwritten character recognition technology (Beatty 2010; Brumfield 2014), for an automatic or even semiautomatic data treatment.
The second challenge went through geocoding about fifty thousand addresses obtained in this documentation, using essentially the computer’s processing power. It is recognized that there are advantages and disadvantages in using several geocoding methods (Goldberg, Wilson, and Knoblock 2007; St-Hilaire et al. 2007; Zandbergen 2008). Its application to Lisbon is made difficult due to the fact that the city have gone through a deep urban morphology transformation and experienced significant changes in its street names throughout the twentieth century (Alves 2005; Oliveira and Pinho 2006). Nevertheless, it remains one of the best methods for automatic assignment of geographic coordinates. The challenge was to think of a process that could overcome the difficulties listed, without having to go through the full reconstitution of the urban network. Not least because the available sources do not made possible the recreation of all the buildings and their functional classification in a GIS environment, as was achieved in other projects (Dunae et al. 2013).
While recognizing the limitations of GIS (Boonstra 2009; Bodenhamer, Corrigan, and Harris 2010; Silveira 2014), it must be highlighted the capabilities of its spatial analysis, processing and data visualization tools, that has been particular useful in the context of urban history (Hillier 2010; DeBats and Gregory 2011; Baics 2016b). In recent years, the use of GIS for the study of cities and their retail trade (Beascoechea Gangoiti 2003; Mirás Araujo 2008; Bassols and Oyón Bañales 2010; Novak and Gilliland 2011; Baics 2016a) has enhanced the theoretical framework and the possibility of international comparative studies, which represented a definitive stimulus to the application of these methodologies to this case study.
Collecting the data
The solution for the first challenge followed a close approach to crowdsourcing projects (Brumfield 2014; Causer and Terras 2014), using shared databases and collaborative work, a method already developed with excellent results in previous studies about literature and the evolution of urban space (Alves and Queiroz 2013). However, it is known that the use of crowdsourcing can be a lengthy process and not always easy to check on the quality of final results. Furthermore, it requires easier access to sources through digital copies because not all potential participants have availability or even competence for archive work. Finally it require an understanding of the historical context of the sources, in order to better transcribe them. In our case, the sources correspond to thick volumes of bound sheets, deposited in a municipal archive without major conditions for local consultation. There was also the problem of the quality of the data, given that we are talking about handwritten information sometimes difficult to read. In this sense, the use of a collaborative work, through volunteer history students with availability and sensitivity to archival work and knowledge of the historical context of the retail trade was decisive.
This data collection was made with a PostgreSQL database, shared with all students through ODBC, so that all data collected by one of the students become available for subsequent use by others. This process, already tested in other project with very good results (Alves and Queiroz 2015), saved up a lot of time in data collection and redundancies were avoided, because a new address or a new commercial activity detected by one of the students in the sources once registered in the database, was automatically available and could be used / selected by all the others. Even if the original record contained an error, because it was registered only once in the database (since the data model prevented duplicates) the validation task was also facilitated.
Building the map and geocoding the data
The option for the second challenge went through the reconstruction of the existing streets network of the time, based on geo-referenced digital cartography and city directories. Thus an addresses’ database was created and, with slight adaptations on the geocoding algorithm of the GIS platform used, allowed for a success rate of around 90%.
The first and greatest of all the problems is related to the urban changes that the city has undergone over the last 120 years. On the one hand, strong population growth led to the expansion or changes in the corresponding urban area, even If we take into account just the three years analyzed. The city of 1890 is very different from the one in 1910, in the layout of the streets, in the expansion into new areas, construction or renovation of its buildings. On the other hand, Lisbon had the particularity to overcome, between 1890 and the present, four very different political regimes that have left a peculiar and deeply transformative mark in the city’s toponymy. Even if the urban area was stable, only the change of street names over more than a century of profound political changes, would pose great challenges to an automated geocoding process.
For this there was first the need to rebuild the streets network of the time, trying to recreate the map of Lisbon of the Belle Epoque. This map was fixed for 1890 and then it was possible to apply the normal geocoding techniques, adapting either the collected data source, or the software algorithm used, in order to overcome difficulties so small, but so significant in the final results, such as the fact that the software was incapable to deal with some Portuguese names and characters or to recognize certain types of streets that were used at the time but ignored or underused today. Or the fact that the names of some streets are identical or very similar in different areas of the city. This was an iterative process of trial and error so as to refine the best model data that maximizes the results obtained.
However, there was still the issue of street names changing over time. For the period in question this problem is not very complicated, since only at the end of 1910 took place the first regime change, the Republican Revolution, with the consequent wave of place names changes. But there was specific changes in some street names, and new streets were open in the city landscape almost every year. These changes were incorporated in the database, maintaining the address structure already geocoded for 1890, allowing to incorporate the data for the same streets that appeared in the sources with different names.
As for the quality or accuracy of geocoding, it is obvious that the ideal would be to have the possibility to rebuild not only the network of city streets, but also the actual location of the various housing / trade blocs. Unfortunately no sources for this level of detail are available, similar to the maps of fire insurance plans available for some north American cities (Novak and Gilliland 2011; Dunae et al. 2013). In the original shapefile map, which represented the city streets in 2012, the streets have information about existing building numbers in each block. Since we have no way of saying, at this stage of the research, how many buildings or doors existed on every block in 1890, it was decided to distribute all points along the entire length of the street, according to the geocoding algorithm. Obviously, this option can cause some significant deviation in less consolidated urban areas of the city, but it is also true that the areas where the overwhelming majority of small businesses traditionally where implemented account for already established streets from the end of the 18th century. So that problem here is much lower, and the geocoding accuracy is much higher.
The reconstruction of the 1890 street map, base of all subsequent work, was made through a current map in shapefile format, provided by the Municipality. This map was superimposed on a digital copy of an old city map properly georeferenced. The mere overlap of the two maps identified a broad set of streets that did not exist at the time (eliminated from the shapefile) and others that changed their layout (fixed in the shapefile). Using city directories, namely one very complete for 1890 mentioning the name, location and building numbers of all city’s streets, it was possible to correct the shapefile street names that had gone through changes over these 120 years. The link between this corrected shapefile and the shops’ addresses collected in the shared database allowed for geocoding, with minor adjustments to the software algorithm, namely, modifying the “.cls” files that contain information about the classes and types of addresses.
Results and reuse of the methodology
Overcoming these issues, it was possible to get a far more dynamic source, more accessible and manageable, able to respond quickly to old research questions or to introduce new perspectives about Lisbon and its retail trade in the Belle Époque. Just to mention one possibility, in the Lisbon municipal archive there are many available data that could be crossed with the information collected on shops and shopkeepers. In particular, it has data on electoral census and elections, with voters lists organized by parishes and addresses, for several years of the nineteenth and twentieth century and this data can also be mapped and analyzed using the methodology now developed. The same can happen with data on primary education, for example, because this fund has information on the addresses of the students also. Given that the addresses of the shops are being collected in a separate table and that it allows to be connected to either the GIS or to other tables with different data, whether on small businesses, on elections or on education, the use of this methodology will allow for results in other projects or to add new information relevant to the history of the city without the need to start everything from scratch.
References
Alves, Daniel. 2005. ‘Using a GIS to Reconstruct the Nineteenth Century Lisbon Parishes’. In Humanities, Computers and Cultural Heritage. Proceedings of the XVIth International Conference of the Association for History and Computing, 12–17. Amsterdam: Royal Netherlands Academy of Arts and Sciences.
———. 2012. A República atrás do balcão: os Lojistas de Lisboa e o fim da Monarquia (1870-1910). Chamusca: Edições Cosmos.
Alves, Daniel, and Ana Isabel Queiroz. 2013. ‘Studying Urban Space and Literary Representations Using GIS: Lisbon, Portugal, 1852-2009’. Social Science History 37 (4): 457–81. doi:10.1215/01455532-2346861.
———. 2015. ‘Exploring Literary Landscapes: From Texts to Spatiotemporal Analysis through Collaborative Work and GIS’. International Journal of Humanities and Arts Computing 9 (1): 57–73. doi:10.3366/ijhac.2015.0138.
Baics, Gergely. 2016a. Feeding Gotham: The Political Economy and Geography of Food in New York, 1790–1860. Princeton: Princeton University Press.
———. 2016b. ‘Mapping as Process: Food Access in Nineteenth-Century New York’. Global Urban History. May 17. https://globalurbanhistory.com/2016/05/17/mapping-as-process-food-access-in-nineteenth-century-new-york/.
Bassols, Manuel Guàrdia, and José Luis Oyón Bañales. 2010. ‘Retailing and Proximity in a Liveable City: The Case of Barcelona Public Markets System’. In REAL CORP 2010: CITIES FOR EVERYONE. Liveable, Healthy, Prosperous, 619–28. Vienna.
Beascoechea Gangoiti, José María. 2003. ‘Jerarquización social del espacio urbano en el Bilbao de la industrialización’. Scripta Nova VII (142): 1–19.
Beatty, Joshua. 2010. ‘Historical Documents in a Digital Library: OCR, Metadata, and Crowdsourcing’. Lemonade & Information. https://lemonadeandinformation.wordpress.com/2010/05/28/historical-documents-in-a-digital-library-ocr-metadata-and-crowdsourcing/.
Bodenhamer, David J., John Corrigan, and Trevor M. Harris, eds. 2010. The Spatial Humanities: GIS and the Future of Humanities Scholarship. Bloomington: Indiana University Press.
Boonstra, Onno. 2009. ‘Barriers between Historical GIS and Historical Scholarship’. International Journal of Humanities and Arts Computing 3 (1–2): 3–7.
Brumfield, Ben W. 2014. ‘Collaborative Digitization at ALA 2014’. Collaborative Manuscript Transcription. http://manuscripttranscription.blogspot.pt/2014/07/collaborative-digitization-at-ala-2014.html.
Causer, Tim, and Melissa Terras. 2014. ‘Crowdsourcing Bentham: Beyond the Traditional Boundaries of Academic History’. International Journal of Humanities and Arts Computing 8 (1): 46–64. doi:10.3366/ijhac.2014.0119.
DeBats, Donald A., and Ian N. Gregory. 2011. ‘Introduction to Historical GIS and the Study of Urban History’. Social Science History 35 (4): 455–63.
Dunae, Patrick A., Donald J. Lafreniere, Jason A. Gilliland, and John S. Lutz. 2013. ‘Dwelling Places and Social Spaces: Revealing the Environments of Urban Workers in Victoria Using Historical GIS’. Labour / Le Travail 72: 37–73.
Goldberg, Daniel W., John P. Wilson, and Craig A. Knoblock. 2007. ‘From Text to Geographic Coordinates: The Current State of Geocoding’. URISA Journal 19 (1): 33–46.
Hillier, Amy. 2010. ‘Invitation to Mapping: How GIS Can Facilitate New Discoveries in Urban and Planning History’. Journal of Planning History 9 (2): 122–34.
Mirás Araujo, Jesús. 2008. ‘The Commercial Sector in an Early-Twentieth Century Spanish City, La Coruña 1914-1935’. Journal of Urban History 34 (3): 458–83.
Monod, David. 1996. Store Wars: Shopkeepers and the Culture of Mass Marketing, 1890-1939. Toronto: University of Toronto Press.
Morris, Jonathan. 1993. The Political Economy of Shopkeeping in Milan, 1886-1922. Cambridge: Cambridge University Press.
Nord, Philip G. 1986. Paris Shopkeepers and the Politics of Resentment. Princeton: Princeton University Press.
Novak, Mathew J., and Jason A. Gilliland. 2011. ‘Trading Places: A Historical Geography of Retailing in London, Canada’. Social Science History 35 (4): 543–70.
Oliveira, Vítor, and Paulo Pinho. 2006. ‘Study of Urban Form in Portugal: A Comparative Analysis of the Cities of Lisbon and Oporto’. Urban Design International 11 (3): 187–201.
Silveira, Luís Espinha da. 2014. ‘Geographic Information Systems and Historical Research: An Appraisal’. International Journal of Humanities and Arts Computing 8 (1): 28–45.
St-Hilaire, Marc, Byron Moldofsky, Laurent Richard, and Mariange Beaudry. 2007. ‘Geocoding and Mapping Historical Census Data: The Geographical Component of the Canadian Century Research Infrastructure.’ Historical Methods 40 (2): 76–91. doi:Article.
Winstanley, Michael J. 1983. The Shopkeeper’s World, 1830-1914. Manchester: Manchester University Press.
Zandbergen, Paul A. 2008. ‘A Comparison of Address Point, Parcel and Street Geocoding Techniques’. Computers, Environment and Urban Systems 32 (3): 214–232.
