6
44 IEEE TECHNOLOGY AND SOCIETY MAGAZINE SEPTEMBER 2016 1932-4529/16©2016IEEE Pascale-L. Blyth, Miloš N. Mladenović, Bonnie A. Nardi, Hamid R. Ekbia, and Norman M. Su Digital Object Identifier 10.1109/MTS.2016.2593199 Date of publication: 7 September 2016 Distributing Benefits and Burdens Expanding the Design Horizon for Self-Driving Vehicles

Expanding the Design Horizon for Self-Driving Vehicles · 44 1932-4529/16©2016IEEE IEEE TECHNOLOGY AND SC IETY MAGAZIN E SEPEMBER Pascale-L. Blyth, Miloš N. Mladenović, Bonnie

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Expanding the Design Horizon for Self-Driving Vehicles · 44 1932-4529/16©2016IEEE IEEE TECHNOLOGY AND SC IETY MAGAZIN E SEPEMBER Pascale-L. Blyth, Miloš N. Mladenović, Bonnie

44 IEEE TEchnology and SocIETy MagazInE ∕ s e p t e m b e r 2 0 1 61932-4529/16©2016IEEE

Pascale-L. Blyth, Miloš N. Mladenović, Bonnie A. Nardi, Hamid R. Ekbia, and Norman M. Su

Digital Object Identifier 10.1109/MTS.2016.2593199 Date of publication: 7 September 2016

Distributing Benefits and Burdens

Expanding the Design Horizon for Self-Driving Vehicles

Page 2: Expanding the Design Horizon for Self-Driving Vehicles · 44 1932-4529/16©2016IEEE IEEE TECHNOLOGY AND SC IETY MAGAZIN E SEPEMBER Pascale-L. Blyth, Miloš N. Mladenović, Bonnie

45s e p t e m b e r 2 0 1 6 ∕ IEEE TEchnology and SocIETy MagazInE

With over one billion vehicles in the world today [1], the motorized road vehicle is the pillar of modern society. Since the beginning of the 20th century, the automobile has revolutionized our spac-

es, practices, cultures, and identities through a complex matrix of technical, financial, economic, political, and so-cial linkages [2], [3]. Visions of automobile use have al-ways shaped its design, manufacture, and production. Now, motorized road transport is set to revolutionize our society once again on a huge scale. Recent technological developments in propulsion, telecommunications, sens-ing, and in-vehicle computing technology are expanding the range of vehicles’ capabilities. A technological conver-gence is underway, moving towards self-driving vehicle (SDV) technology. These vehicles will utilize computation-al algorithms, sensors, and communication devices to au-tomatically navigate a variety of environments with limit-ed or no intervention from human drivers.

While vehicular automation has existed in varying forms for quite some time (e.g., autopilot systems,

automated trains), SDVs offer potential for revolu-tionary outcomes. SDV technology promises to shape society in broader and more pervasive ways,

potentially resulting in a greater level of societal disruption than other automated vehicle sys-tems. SDV technology might even bring about

a level of societal disruption equal to that of personal computers. Current popular

discourse is beginning to outline a vision of the benefits and limitations

of this disruption.In the spirit of responsible inno-

vation, wherein the innovation process should be aligned with social needs [4]–[6], we will argue that SDVs introduce new challeng-es in terms of social justice, affecting the distribution of bene-

fits and burdens across society as a whole [7]. Our starting premise is

that technology is a profoundly social phenomenon, with both intended and

unintended consequences (positive and negative) for our everyday lives. By assuming a positive and unproblematic future for SDV technology, current design practices and institutions have systematically ignored a number of critical social and ethical challenges. Conse-quently, we will argue that a better understanding of the technology in a broader social context, along with open discussion of the distribution of burdens and benefits in a current and future society, enables the development of

an improved design practice. We argue for an “expanded technological design horizon” that engages a more ethi-cal design practice for SDV technology. In doing so, we aspire to steer current engineering practices beyond a narrow, technical perspective. Ultimately, we hope to broaden the conversation about design processes in general for technologies that are likely to shape societal development on a large scale.

How are SDVs Currently Defined?It is essential to clarify the current technological defini-tions of SDV technology. The SDV is an arrangement of technologies whose aim is to remove some or all of a driv-er’s actions and interventions. Consequently, SDVs are expected to navigate their environment with little or no driver input. This development represents a vision of transport technology that has arisen from the technology market and is set to shape transport. According to this vision, five levels of automation or driver input are defined in engineering standards. These levels vary from driver assistance to full automation [8]–[13]. The level of automa-tion represents the level of driver responsibility for con-trolling the vehicle and monitoring the environment.

Before SDVs, conventional vehicles were already tech-nologically sophisticated, making use of sensing, process-ing, and communications technologies to collect, process, and communicate data about the vehicle (such as engine performance) and its environment (such as parking sensors or reversing cameras). However, in order to navigate any environment with little or no human action, a multitude of powerful, sophisticated sensors must be included. These sensors gather many different kinds of data (e.g., geographical coordinates, speed, acceleration, and obstacles in close proximity) to build a comprehensive representation of the vehicle and its sur-rounding environment. To handle such complex data in real-time, SDVs require increased processing power and data storage capacity, accompanied by sophisticated algo-rithms to make and monitor driving decisions. According to some SDV visions, these two sets of technologies alone are enough to enable the SDV to navigate its environ-ment. However, some visions argue that SDVs will also have to include communications technologies to enable direct, fast communication with other vehicles or sur-rounding infrastructure. This communication capability might enable advanced features such as “platooning,” where vehicles deliberately and intelligently coordinate their speed and share information about road conditions (such as seen in the film Minority Report).

What Are The Current Visions of SDV Benefits and Limitations?An integral aspect of any technology is the underlying vision of the future and associated values. Such vision

Page 3: Expanding the Design Horizon for Self-Driving Vehicles · 44 1932-4529/16©2016IEEE IEEE TECHNOLOGY AND SC IETY MAGAZIN E SEPEMBER Pascale-L. Blyth, Miloš N. Mladenović, Bonnie

46 IEEE TEchnology and SocIETy MagazInE ∕ s e p t e m b e r 2 0 1 6

is commonly used to usher in new technologies. Tech-nological visions have several themes. They typically seek to address a perceived social need rooted in the present, and tend to position contemporary technolo-gies as being inadequate for modern society’s needs. They typically argue that the new technology will sur-pass prior technological transitions [14]. Visions of SDV technology typically critique existing automotive tech-nology, claim to address social needs, and solve many issues associated with the automobile.

At first glance, SDVs are a panacea for issues such as traffic deaths and injuries, pollution, concerns over fossil fuel use, problems of congestion and parking shortages, expensive public transport provision, and the externalities of freight transport. Current visions of SDVs promise a future offering increased safety, speed, convenience, and productivity, while reducing energy consumption. For example, a common argument for SDV technology is its capability to engineer a future with fewer road accidents and, consequently, fewer injuries and casualties. SDVs will determine the route and how fast to travel to improve traffic flow, thereby optimizing energy use and reducing congestion. The visions of SDV technology promise sub-stantial car sharing and even lower car ownership, thus reducing the amount of parking spaces required.

However, beyond the technologically-mediated visions of these futures, there are some real concerns about the impact of SDV technology, and many uncertainties about what SDVs may actually bring about. These uncertainties include whether occupants will be able to respond in time to hazardous situations, and whether SDVs can perform as well as human drivers. A common concern is liability in the case of traffic accidents. There are concerns about the level of infrastructure investment required to enable full automation across geographical areas, the potential economic and social impact of displacing driving jobs, and the potential energy demand based on the comput-ing power and redundant systems potentially needed for SDVs. Little is known about who will own the vast quanti-ties of data collected about the environment and about passengers, how private such data may or may not be, and vulnerabilities of the computer systems involved to hacking and criminal activity.

Current visions of expected benefits and limitations stem from technology development practices situated in the dominant economic culture. Our market-based cul-ture is shaped by many interconnected institutions including the media, government, law enforcement, and the insurance industry. For example, the entertainment industry frequently glamorizes speed. The mass media receive substantial revenues from alcohol and automo-tive advertising, both of which air in programming typi-cally targeting a young male audience. Many accidents involving young males result from beer consumption

combined with speeding [15]. The insurance and auto-motive industries, in combination with law enforcement and government, also shape the automobile and our experience with it [15].

The power originating from this complex context often shapes technological visions, as well as the deci-sion-making related to those visions [16]. While we do not know exactly which visions will be enacted, current visions risk blinding technology developers and regula-tors to potential beneficial transformative societal changes and challenges in transportation [17].

What is Missing from Current SDV Visions?In addition to the challenges facing SDV technology that we have identified, the current vision of SDV technology has a narrow focus privileging the requirements of tech-nological and commercial development, while at the same time neglecting potentially serious social conse-quences. One of the recurring themes is that SDVs are possessed of “algorithmic authority” superior to “human authority” that enable SDVs to navigate the environment more effectively. There are even visions of SDVs as ethical robots, programmable to solve moral dilemmas that they could face between killing an indi-vidual and killing a group. These visions of SDVs as ethi-cal robots are part of an emerging trend in robotics [18]. Yet we do not yet have the necessary rich set of scenari-os and use cases about the difficult moral and ethical dilemmas that SDVs will have to resolve. These scenari-os and use cases are necessary to assess the social consequences of this new technology.

We know from the history of the automobile how dev-astating the consequences can be. For example, a belief that passive devices were superior to active devices meant early airbags in U.S. cars were used instead of seat belts despite scientific evidence that their design increased the total number of deaths in accidents. Women were disproportionately affected, because of their smaller sizes [15]. The societal costs of 1.24 million road deaths a year (nearly triple the UN’s annual global estimate of murders and twenty times the number of deaths attributable to wars each year), is a ghastly reminder of how lethal automotive transportation is [19], [20]. This does not even take account the much greater number of those maimed as a result of traffic accidents.

One set of missing requirements in SDV develop-ment relates to the changing role of the driver’s ethical responsibility and legal liability for accidents. Most designs for SDVs do not completely do away with the driver, requiring them to take over in emergencies, thus raising the issue of who is responsible for negative out-comes. Future laws may not treat the occupants and the vehicle manufacturer equally, with the SDV driver poten-tially held accountable for failing to respond to danger

Page 4: Expanding the Design Horizon for Self-Driving Vehicles · 44 1932-4529/16©2016IEEE IEEE TECHNOLOGY AND SC IETY MAGAZIN E SEPEMBER Pascale-L. Blyth, Miloš N. Mladenović, Bonnie

47s e p t e m b e r 2 0 1 6 ∕ IEEE TEchnology and SocIETy MagazInE

warnings. In addition, by virtue of the human being present, the human may be made primarily or solely legally responsible, putting them at a significant disad-vantage compared to the technology manufacturer [17]. We do not yet have case law for assessing the division of human-machine responsibility, and the issues are very thorny indeed.

Another concern about the narrowness of the cur-rent technological visions revolves around daily mobility practices. The effect of SDVs on mobility practices is unknown. Despite assurances that they will save fuel, save time, and so on, their use might in fact increase the total distances traveled (as in a car-sharing model they travel instead of being parked), time traveled and so on, which would affect emissions. SDVs could bring about a “speed hierarchy” in which the extra speed gained from automation will command a premium price. Geographies of access to mobility could appear – such as those geographies of clean air shaped by elec-tric car subsidies in California [21].

Wide deployment of SDV technology might create inequality by pricing out certain segments of society, and constraining the available set of transport alterna-tives. We know from studies of the transition to the automobile in the U.S. that local residents objected to cars because they saw automobiles as transforming the street into a transport artery rather than a meeting place. In the end, the residents were right, and local trade and social life suffered [3]. Traffic flow was priori-tized over the safety of pedestrians, beginning the trend of a shockingly high rate of pedestrian deaths. In the case of SDVs, the high cost of infrastructure could deflect resources from alternatives such as public trans-port, walking and cycling, shaping urban land use even more heavily in favor of cars [22]. SDVs could impose scarcity of choice, time, and cost, making the traveler merely a client of a service, not a citizen or a friend. This client is a person who can only ask for better ser-vice in the form of more complex technological solu-tions, but not for social justice [23]. SDVs may then reshape transport practices broadly along the lines of those who can afford the use of SDVs and who cannot.

There is a danger that the scale of the infrastructure investment necessary for widespread SDV deployment would put further pressure on public funding, possibly resulting in funding cuts to other critical public services such as healthcare and education. In the U.S., the tran-sition to the automobile demonstrates that a wealthy, educated middle class consisting of planners, judges, and entrepreneurs were able to define the use of the automobile, including deciding who could drive and where, and who would ride public transport [3]. Three hundred million dollars was spent in the U.S. in 1906 to build roads, redefining social geographies in and out-

side of cities [3]. More recently, the development of “smart cities” that purchase turnkey big data solutions has, in some cases, resulted in diverting public spend-ing to finance the new “smart” technologies [24]–[26].

Other broader economic, institutional, and cultural fac-tors come into play as well. For example, while SDV tech-nology might be completely based on battery-electric propulsion, sustainability of such energy systems is nei-ther considered nor proven. SDVs may change the politi-cal economy of employment in sectors such as delivery where higher speeds for delivery vehicles could enable an increase in the distance travelled by goods purely for prof-it. As a result, retailers could have increased choice in terms of potential suppliers. This could result in more competition thus driving down prices paid, for example, to local farmers.

Current development visions neglect a range of poten-tial implications of the technology for civic values such as privacy, harmony, and mutual respect [7], [27]. Reprising Langdon Winner, a technology that is socially-constructed to be totalitarian requires a police state to administer [28]. Therefore, SDV technology, with the huge quantities of data involved, could open the possibility of a police state, or, some might argue, even more of a police state than we already have. Such changes could shift the range and nature of civic values toward totalitarian controls. The automation and sensor technologies that character-ize SDVs have military applications, and are found in mili-tary autonomous vehicles and drones. Therefore the technological development of SDV technology may result in a growing market for military applications—an unfortu-nate outcome, in our view. The military-industrial complex is continually fed as corporations tap the military as a nearly bottomless pot of money (in the U.S. at least), encouraging the very socio-political complex we should be dismantling rather than sustaining and strengthening. Technology is being used to fight an increasing number of wars abroad [29], endangering harmony with foreign countries, and encouraging the use of war as an active component of foreign policy. Without explicitly declaring war, in their military applications the technologies involved could enable the erection of barriers to mobility across countries. Worldwide, 50-350 million people are expected to be displaced by 2050 by crop failures, drought, and wars caused by climate change [30]. Mean-while, the U.S. and the EU are investing heavily in robots, drones, and surveillance buoys [30] with the same sensor and automation technologies, meaning that an SDV soci-ety could be one with more wars and less social and geo-graphical mobility.

Finally, it is important to emphasize that a society that uses forms of social control and discipline based on surveillance and monitoring will almost inevitably create new laws to support that social order. One

Page 5: Expanding the Design Horizon for Self-Driving Vehicles · 44 1932-4529/16©2016IEEE IEEE TECHNOLOGY AND SC IETY MAGAZIN E SEPEMBER Pascale-L. Blyth, Miloš N. Mladenović, Bonnie

48 IEEE TEchnology and SocIETy MagazInE ∕ s e p t e m b e r 2 0 1 6

contemporary example is the creation of the crime of “theft of time,” “defined as the misuse of an employer’s time and property by an employee,” an offense punish-able by dismissal from employment [16], [31], [32]. A contemporary study of trucking finds a strong cost motive for the use of GPS technology for surveillance and monitoring, as well as a tool to control and disci-pline driver behavior [32]. Consequently, SDV technolo-gy may give rise to new forms of social control and discipline by enabling knowledge of our practices.

Why the SDV Vision Should Not Remain NarrowWe argue that the current vision of SDV technological development cannot retain its narrow perspective. It neglects to take account of the fact that technology embodies social relations and political meanings [28], and has the potential to shape society, infrastructure, practice, and ideology. Technology may be useful for certain purposes and, at the same time, carry serious consequences such as loss of privacy, alterations in social relations, degradation of skills, and environmen-tal devastation [33]. Ultimately, technology is a pro-foundly social phenomenon, with both intended and unintended consequences for our everyday lives [23], [34]–[37], and the potential to shape society, infrastruc-ture, practice, and ideology.

By aiming primarily to solve the problems of the pre-vious technology, i.e., the automobile, the current vision of SDV technology falls short in two important aspects. First, it neglects a range of societal dimensions of tech-nology. It fails to recognize interdependencies between societal dimensions. It does not account for the broader picture of why and how society uses technology in the first place, and how technology continues to influence and shape societal structures and relations. Second, the current approach to SDV development is deterministic, assuming that the specific future it imagines is “inevita-ble.” The current design approach thus does not allow for the development and evaluation of alternative futures that might be based on broad, democratic public dis-cussions with multiple stakeholders. Consequently, a single potential future becomes the one that is decided and inevitable, and we must move toward it.

Ultimately, the development of SDV technology is a question of social justice, and should be assessed in nuanced, pluralistic ways according to the manner in which it carries out distribution of benefits and burdens across current and future societies. It is exactly this pre-eminence given to a single positive and unproblematic future that has led to systematic sidestepping of impor-tant ethical and social challenges. As technology design-ers and implementers, we have a responsibility to design for the future for all people in an equitable way. SDV development is, then, an activity of moral choice,

laden with an imperative to imagine a range of desired alternative futures. We need to make normative choices about which future we will aspire to, and the future can-not be based on profit alone.

How Can We Expand the SDV Design Vision?If design practice is to account for this wider and future-oriented perspective, there is a need for a significant par-adigm shift and evolution of design practices. If we consider only narrowly-conceived notions of the usability and usefulness of technology, there is a danger of neglecting the complexity of broader sociotechnical sys-tems and the interdependencies between technical and social justice considerations. A starting point for such a paradigm shift is to study what people are doing with technical systems and why. Such an approach would require expanding the focus on SDVs as primarily techni-cal objects, and taking account of the broader sociotech-nical systems in which they are embedded, including multiple stakeholders, impacts on infrastructure and environment, and distribution of benefits and burdens. Design should be seen as “inventing the future,” by imagining a range of possible and desired futures, while considering a range of values [38]. It is important to take seriously the cultural-historical imperative and to under-stand design influences as flowing from global techno-capitalism and socio-technical change [38].

An immediate challenge arises when designers are faced with accommodating conflicting values such as a traffic control mechanism for SDVs that balances ques-tions of safety, privacy, mobility, and environmental sus-tainability. A framework for the ethical design of SDVs must consider a range of implications of technology auto-mation and the future. These include greater degrees of embeddedness and interconnectivity that generate social and political complexities, issues of privacy and responsi-bility, and changes in cultural values. The first step in dealing with this complexity in technology design would be accepting that complexity exists. By looking away or shrugging at this complexity, engineers and designers are losing a critical opportunity to better understand the dis-tribution of benefits and burdens that SDV technology will have on current and future generations.

Shaping the FutureA complexity- and foresight-based approach enables a perspective in which the future is something that can be shaped; it is neither “already decided” nor “inevitable.” A sociotechnical design framework should account for the changing role of the human inside and outside the vehicle as well as consequent impacts on sociotechnical struc-tures and practices. For example, how would the SDV reconfigure practices of driving and mobility planning for different users, different trip purposes, and different daily

Page 6: Expanding the Design Horizon for Self-Driving Vehicles · 44 1932-4529/16©2016IEEE IEEE TECHNOLOGY AND SC IETY MAGAZIN E SEPEMBER Pascale-L. Blyth, Miloš N. Mladenović, Bonnie

49s e p t e m b e r 2 0 1 6 ∕ IEEE TEchnology and SocIETy MagazInE

activities? The framework should focus on the develop-ment of a range of possible and desired futures, and assessment of their system- level impacts. These assess-ments should include environmental and social justice perspectives on the distribution of burdens and benefits across society, both now and in the future. The sociotech-nical framework should account for the roles, objectives, and design approaches of those interested in technologi-cal development, including corporations, government, and researchers. Finally, a paradigm shift would require involving the general public throughout the entire design process. This element would include cooperation with institutional mechanisms to evaluate a wide range of gen-eral and localized values in the design of SDV technology. SDVs are potentially highly disruptive technologies with profound implications on social justice in the transport system and beyond. As the technology is at its foundation-al stage of development, the critical concerns related to the improvement of design practices must be addressed right now.

Author InformationPascale-L. Blyth and Miloš N. Mladenovic are with the Department of Built Environment, Aalto University, Fin-land. Email: [email protected].

Bonnie A. Nardi is with the Donald Bren School of Infor-mation and Computer Sciences, University of California, Irvine, Irvine, CA.

Hamid R. Ekbia and Norman Makoto Su are with the School of Informatics and Computing, Indiana University Bloomington, Bloomington, IN.

References[1] J. Sousanis, “World vehicle population tops 1 billion units,” Ward-sAuto, 2011. [Online]. Available: http://wardsauto.com/ar/world_vehi-cle_population_110815. [Accessed: 03-Jun-2015].[2] J. Urry, “The ‘system’ of automobility,” Theory, Cult. Soc, vol. 21, no. 4–5, pp. 25–39, Oct 2004.[3] F. W. Geels, “The dynamics of transitions in socio-technical sys-tems: A multi-level analysis of the transition pathway from horse-drawn carriages to automobiles (1860–1930),” Technol. Anal. Strat-eg. Manag, vol. 17, no. 4, pp. 445–476, Dec 2005.[4] J. van den Hoven and K. Jacob, “EUR 25766 - Options for strengthening responsible research and innovation,” Publications Office of the European Union, Luxembourg, 2013.[5] R. Owen, J. Bessant, and M. Heintz, Eds., Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society, 1st ed. Chichester: Wiley, 2013.[6] T. Hellström, “Systemic innovation and risk: Technology assess-ment and the challenge of responsible innovation,” Technol. Soc, vol. 25, no. 3, pp. 369–384, 2003.[7] M. N. Mladenovic and T. McPherson, “Engineering social justice into traffic control for self-driving vehicles?,” Sci. Eng. Ethics, pp. 1–19, 2015. [8] L. D. Baskar, B. De Schutter, J. Hellendoorn, and Z. Papp, “Traffic control and intelligent vehicle highway systems: A survey,” IET Intell. Transp. Syst, vol. 5, no. 1, pp. 38–52, 2011.[9] U. Lee and M. Gerla, “A survey of urban vehicular sensing plat-forms,” Comput. Networks, vol. 54, no. 4, pp. 527–544, 2010.[10] National Highway Traffic Safety Administration. “Preliminary Statement of Policy Concerning Automated Vehicles,” Washington, DC, 2013.

[11] S. Olariu and M. C. Weigle, Eds., Vehicular Networks: From Theo-ry to Practice, 1st ed. Chapman & Hall/CRC Press, 2009.[12] U. Ozguner, T. Acarman, and K. A. Redmill, Autonomous Ground Vehicles. Boston/London: Artech House, 2011.[13] G. Leen and D. Heffernan, “Expanding Automotive Electronic Systems,” Computer (Long. Beach. Calif), vol. 35, no. 1, pp. 88–93, 2002.[14] B. K. Sovacool and B. Brossmann, The rhetorical fantasy of ener-gy transitions: Implications for energy policy and analysis,” Technol. Anal. Strateg. Manag, vol. 26, no. 7, pp. 837–854, 2014.[15] L. Evans, Death in traffic: Why Are the ethical issues ignored?,” Stud. Ethics. Law. Technol, vol. 2, no. 1, 2008.[16] L. Snider, “Crimes against capital: Discovering theft of time,” Soc. Justice, vol. 28, no. 3, pp. 105–120, 2001. [17] B. W. Smith, “A legal perspective on three misconceptions in vehicle automation,” in Road Vehicle Automation, G. Meyer and S. Beiker, Eds. Springer, 2014, pp. 85–91.[18] K. W. Miller, M. J. Wolf, and F. Grodzinsky, This ‘ethical trap’ is for roboticists, not robots: On the issue of artificial agent ethical decision-making,” Sci. Eng. Ethics, 2016. [19] United Nations Department of Economic and Social Affairs Popu-lation Division. “Changing Levels and Trends in Mortality: The role of patterns of death by cause,” New York, NY, 2012.[20] World Health Organization (WHO). “Global status report on road safety 2013: Supporting a decade of action,” Geneva, Switzerland, 2013.[21] L. Margonelli, “Clean air is for the wealthy,” Slate, 2014. [Online]. Available: http://www.slate.com/articles/technology/future_tense/2014/09/california_s_green_vehicle_subsidies_and_income_inequality.html. [Accessed: 01-May-2016].[22] J. Jacobs, The Death and Life of Great American Cities, 1st ed. London, U.K.: Jonathan Cape, 1962.[23] I. Illich, Energy and Equity, 5th ed. London, U.K.: Marion Boyars, 1979.[24] O. Söderström, T. Paasche, and F. Klauser, Smart cities as corpo-rate storytelling,” City, vol. 18, no. 3, pp. 307–320, 2014.[25] A. Wiig, The empty rhetoric of the smart city: from digital inclu-sion to economic promotion in Philadelphia,” Urban Geogr, vol. 3638, pp. 1–19, Jan 2015. [26] D. Mcneill, “Global firms and smart technologies: IBM and the reduc-tion of cities,” Trans. Inst. Br. Geogr, vol. 40, no. 4, pp. 562–574, 2015.[27] R. Kreissl, Assessing security technology’s impact: Old tools for new problems,” Sci. Eng. Ethics, vol. 20, no. 3, pp. 659–673, 2014.[28] L. Winner, “Do artifacts have politics?,” in The Whale and the Reactor: A Search For Limits in an Age of High Technology, 3rd ed., Chicago, IL: University of Chicago Press, 1992, pp. 19–39.[29] R. Sparrow, “‘Just say no’ to drones,” IEEE Technol. Soc. Mag, vol. 31, no. 1, pp. 56–63, 2012.[30] J. Yager, “Night train to freedom. A quarter-century of open bor-ders in the E.U. is coming to a close,” The Awl, 2016. [Online]. Avail-able: http://www.theawl.com/2016/04/night-train-to-freedom.[31] R. C. Hollinger and J. P. Clark, Deterrence in the workplace: perceived certainty, perceived severity, and employee theft,” Soc. Forces, vol. 62, no. 2, pp. 398–418, 1983.”[32] J. Karp, GPS in interstate trucking in Australia: Intelligence, surveillance?or compliance tool?,” IEEE Technology and Society Mag, vol. 33, no. 2, pp. 47–52, 2014.[33] B. Nardi, “Appropriating Theory,” in Theory Development in the Information Sciences: Reflecting on the Process, 1st ed., D. Sonnen-wald, Ed. Austin, TX: University of Texas Press, 2016.[34] J. Ellul, The Technological Society. Toronto, Canada: Alfred A. Knopf, Inc. and Random House, Inc Vintage Books, 1964.[35] A. Feenberg, Questioning Technology, 1st ed. New York, NY: Harper & Row, 1977.[36] A. Borgmann, Technology and the Character of Contemporary Life: A Philosophical Inquiry. Chicago, IL: Univ. of Chicago Press, 1987.[37] M. Heidegger, The Question Concerning Technology and Other Essays. New York, NY: Harper & Row, 1977.[38] H. Ekbia and B. Nardi, The political economy of computing: The elephant in the HCI room,” ACM Interact, vol. 22, no. 6, pp. 46–49, 2015.

All in-text references underlined in blue are linked to publications on ResearchGate, letting you access and read them immediately.