Electronic Commerce Research and Applications

Volume 6 • Issue 6

  • ISSN: 1567-4223

Editor-In-Chief: Christopher Yang

  • 5 Year impact factor: 6.9
  • Impact factor: 5.9
  • Journal metrics

Electronic Commerce Research and Applications aims to create and disseminate enduring knowledge for the fast-changing e-commerce environment. A major dilemma in e-commerce resea… Read more

Electronic Commerce Research and Applications

Subscription options

Institutional subscription on sciencedirect.

Electronic Commerce Research and Applications aims to create and disseminate enduring knowledge for the fast-changing e-commerce environment. A major dilemma in e-commerce research is how to achieve a balance between the currency and the life span of knowledge.

Electronic Commerce Research and Applications will contribute to the establishment of a research community to create the knowledge, technology, theory, and applications for the development of electronic commerce . This is targeted at the intersection of technological potential and business aims.

E-commerce is a multi-disciplinary area, which should be developed in co-operation with existing fields such as Information Systems and Technology; Computing and Informatics; Marketing, Finance and Supply Chain Management; Business Strategy and Management; Artificial Intelligence/Machine Learning; Data Science and Business Data Analytics; Public Policy; and Legal Studies. We will solicit papers on current technologies from these areas, as well as publish papers on completely new topics. We also seek proposals for special issues on new topics in e-commerce that will create new directions for research.

Electronic Commerce Research and Applications is inviting submission of articles, including but not limited to the following topics:Agent-based commerce; electronic auctions; e-business models; B2C and B2B EC; consumer behavior; customer relationship management and data mining; recommender systems; Internet search engines and Web mining; big data analytics; social media and commerce analytics; responsible and trustworthy artificial intelligence; pricing and marketing; digital economy and digital transformation; e-government, public policy and digital divide issues; electronic payment systems; sharing economy; (IT and e-services; exchanges and electronic marketplaces;) e-commerce in supply chain and inventory management; legal issues in e-commerce; (industry studies and case analysis;) economic and management science modeling; organizational and theory-building research; empirical studies of e-commerce problems; behavioral studies of e-commerce issues; protocols, technology and process standards for e-commerce; (transformation of industries;) security and trust; credit card and smart card applications; mobile-commerce and ubiquitous computing; inter-organizational systems in e-commerce; emerging technologies and technological innovation.

Electronic Commerce Research and Applications

Volume 66, Issue C

  • Elsevier Science Publishers B. V.
  • PO Box 211 1000 AE Amsterdam
  • Netherlands

Subject Areas

Most frequent affiliations, most cited authors, latest issue.

  • Volume 66, Issue C Jul 2024 ISSN: 1567-4223 View Table of Contents

Editorial Board

How perceived justice leads to stickiness to short-term rental platforms: unveiling the effect of relationship commitment and trust.

Renmin University of China, Beijing, China

University of International Business and Economics, Beijing, China

Information transmit strategy of e-commerce platform with financially constrained supplier

Research Center for Innovation and Development of Equipment Manufacturing Industry, Taiyuan University of Science and Technology, Taiyuan 030024, China

College of Economy and Management, Taiyuan University of Science and Technology, Taiyuan 030024, China

Research on the joint event extraction method orientates food live e-commerce

Beijing Key Laboratory of Big Data Technology for Food Safety, Beijing Technology and Business University, Beijing 100048, China

Sub-institute of Standardization Theory and Strategy, China National Institute of Standardization(CNIS), Beijing 100088, China

The Law Promotion Center of the Ministry of Justice of the People’s Republic of China, Beijing 100020, China

Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China

Beijing PAIDE Science and Technology Development Co. Ltd., Beijing 100097, China

Improved negative sampling method in collaborative filtering recommendation based on Generative adversarial network

College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, China

College of Information Engineering, Nanjing University of Finance & Economics, Nanjing 210023, China

Recent Award Winners

Most popular, export citations.

  • Please download or close your previous search result export first before starting a new bulk export. Preview is not available. By clicking download, a status dialog will open to start the export process. The process may take a few minutes but once it finishes a file will be downloadable from your browser. You may continue to browse the DL while the export process is in progress. Download
  • Download citation
  • Copy citation

We are preparing your search results for download ...

We will inform you here when the file is ready.

Your file of search results citations is now ready.

Your search export query has expired. Please try again.

Economics and Electronic Commerce

Google is a global leader in electronic commerce. Not surprisingly, considerable attention is devoted to research in this area. Topics include 1) auction design, 2) advertising effectiveness, 3) statistical methods, 4) forecasting and prediction, 5) survey research, 6) policy analysis and a host of other topics. This research involves interdisciplinary collaboration among computer scientists, economists, statisticians, and analytic marketing researchers both at Google and academic institutions around the world.

A major challenge is solving these problems at very large scales. For example, the advertising market has billions of transactions daily, spread across millions of advertisers, presenting a unique opportunity to test and refine economic principles as applied to a very large number of interacting, self-interested parties with a myriad of objectives. At Google, research is an opportunity to translate direction into practice, influencing how production systems are designed and used.

Recent Publications

Some of our teams.

Algorithms & optimization

Graph mining

Impact-Driven Research, Innovation and Moonshots

Market algorithms

We're always looking for more talented, passionate people.

Careers

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • Springer Nature - PMC COVID-19 Collection

Logo of phenaturepg

20 years of Electronic Commerce Research

Satish kumar.

1 Department of Management Studies, Malaviya National Institute of Technology, Jaipur, Rajasthan 302017 India

Weng Marc Lim

2 Swinburne Business School, Swinburne University of Technology, John Street, Hawthorn, Victoria 3122 Australia

3 School of Business, Swinburne University of Technology, Jalan Simpang Tiga, 93350 Kuching, Sarawak Malaysia

Nitesh Pandey

J. christopher westland.

4 Department of Information and Decision Sciences, University of Illinois – Chicago, 601 S. Morgan Street, Chicago, Illinois 60607-7124 USA

2021 marks the 20th anniversary of the founding of Electronic Commerce Research ( ECR ). The journal has changed substantially over its life, reflecting the wider changes in the tools and commercial focus of electronic commerce. ECR ’s early focus was telecommunications and electronic commerce. After reorganization and new editorship in 2014, that focus expanded to embrace emerging tools, business models, and applications in electronic commerce, with an emphasis on the innovations and the vibrant growth of electronic commerce in Asia. Over this time, ECR ’s impact and volume of publications have grown rapidly, and ECR is considered one of the premier journals in its discipline. This invited research summarizes the evolution of ECR ’s research focus over its history.

Introduction

The year 2021 marks the 20th anniversary of the founding of Electronic Commerce Research ( ECR ). The journal has changed substantially over its life, reflecting the wider changes in the tools and commercial focus of electronic commerce. ECR ’s early focus was on telecommunications and electronic commerce. After reorganization and new editorship in 2014, that focus expanded to embrace emerging tools, business models, and applications in electronic commerce, with an emphasis on emerging technologies and the vibrant growth of electronic commerce in Asia. Over these years, ECR has steadily improved its stature and impact, as evidenced through various quantitative (e.g., citations, impact factors) and qualitative (e.g., peer-informed journal ranks) measures. According to Clarivate Analytics, ECR ’s impact factor in 2019 was 2.507, 1 which means that articles published in ECR between 2017 and 2018 received an average of 2.507 citations from journals indexed in Web of Science in 2019. The five-year impact factor of ECR was 2.643, 1 which indicates that articles published in ECR between 2014 and 2018 received an average of 2.643 citations from Web of Science-indexed journals in 2019. According to Scopus, ECR ’s CiteScore was 4.3, 2 which implies that articles published in ECR between 2016 and 2019 received an average of 4.3 citations from journals indexed in Scopus in 2019. The source normalized impact per paper (SNIP) of ECR was 1.962, which suggests that the average citations received by articles in the journal is 1.962 times the average citations received by articles in the same subject area of Scopus-indexed journals in 2019. Apart from these quantitative measures, ECR has also been rated highly by peers in the field, as seen through journal quality lists. For example, ECR has been consistently ranked as an “A” journal by the Excellence in Research for Australia (ERA 2010) and the Australian Business Deans Council (ABDC 2013, 2016, 2019) journal ranking lists.

This research presents a 20-year retrospective bibliometric analysis of the evolution of context and focus of ECR ’s articles [ 1 – 5 ]. To curate a rich bibliometric overview of ECR ’s scientific achievements, this study explores seven research questions (RQ) which are commonly asked by both authors and our Editorial Board members:

  • RQ1. What is the trend of publication and citation in ECR ?
  • RQ2. Who are the most prolific contributors (authors, institutions, and countries) in ECR ?
  • RQ3. What are the most influential publications in ECR ?
  • RQ4. Where have ECR publications been cited the most?
  • RQ5. What is the trend of collaboration in ECR ?
  • RQ6. Who are the most important constituents of the collaboration network in ECR ?
  • RQ7. What are the major research themes in ECR ?

A bibliometric analysis can offer a broad, systematic overview of the literature to delineate the evolution of electronic commerce technologies, and point the direction to trending topics and methodologies [ 5 – 14 ]. Our research is organized as follows. Section  2 outlines our bibliometric methodology. Section  3 goes on to performance analysis to uncover contributor and journal performance trends (RQ1–RQ4), the co-authorship analysis performed to unpack collaboration and constituent characteristics (RQ5–RQ6), and the bibliometric coupling and keyword analyses used to reveal the major themes and trends within the ECR corpus (RQ7). Section  4 applies graph theoretic analysis. Section  5 applies cluster analysis. Section 6 applies thematic analysis. Finally, we conclude the study with key takeaways from this retrospective.

Methodology

Bibliometric methodologies apply graph theoretic and statistical tools for analysis of bibliographic data [ 15 ] and include performance analysis and science mapping [ 16 ]. To answer research question 1 to research question 4, this study uses performance analysis to measure the output of authors’ productivity and impact, with productivity measured using publications per year, and impact measured using citations per year. We begin by measuring the productivity and impact of ECR , and then the productivity and impact of authors, institutions, and countries using both publications and citations per year metrics on top of ancillary measures such as citations per publication and h -index. Finally, we measure the impact of ECR articles using citations and shed light on prominent publication outlets citing ECR articles.

To answer research question 5 to research question 7, this study uses co-authorship, bibliographic coupling, and keyword analyses. We begin by conducting a co-authorship analysis, which is a network-based analysis that scrutinizes the relationships among journal contributors [ 17 ]. Next, we perform bibliographic coupling to obtain the major themes within the ECR corpus. The assumption of bibliographic coupling connotes that two documents would be similar in content if they share similar references [ 18 , 19 ]. Using article references, a network was created, wherein shared references were assigned with edge weights and documents were denoted with nodes. The documents were divided into thematic clusters using the Newman and Girvan [ 20 ] algorithm. Finally, we track the development of themes throughout different time periods using a temporal keyword analysis. The assumption of this analysis suggest that keywords are representative of the author’s intent [ 21 ] and thus important for understanding the prominence of themes pursued by authors across different time periods. Indeed, we found that these bibliometric methods complement each other relatively well, as bibliographic coupling was useful to locate general themes while keywords were useful to understand specific topics.

To acquire bibliographic data of ECR articles for the bibliometric analyses mentioned above, this study uses the Scopus database, which is one of the largest academic database that is almost 60% larger than the Web of Science [ 21 ]. Past research has also indicated that the citations presented within the Scopus database correlate more with expert judgement as compared to Google Scholar and Web of Science [ 22 ]. We begin by conducting a source search for “ Electronic Commerce Research ,” which resulted in 927 articles, and after filtering out non- ECR articles, we obtain a list of 516 ECR articles (see Fig.  1 ). However, ECR only gained Scopus indexation in 2005, and thus, only 443 ECR articles (2005–2020) contained full bibliometric data, whereas the remaining 73 ECR articles (2001–2004) contained only partial bibliometric data (e.g., no affiliation, abstract, and keyword entry). All 516 ECR articles were fetched and included in the performance analysis as partial bibliometric data was sufficient, but only 443 ECR articles were included in science mapping (e.g., co-authorship, bibliographic coupling, and keyword analyses using VOSviewer [ 23 ] and Gephi [ 24 ]) as full bibliometric data was required. This collection of articles met the minimum sample size of 200 articles for bibliometric analysis recommended by Rogers, Szomszor, and Adams [ 25 ].

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig1_HTML.jpg

Research design. Note Bibliometric analysis was conducted for only 443 (primary) documents as 73 (secondary) documents lack full data (affiliation, abstract and keywords)

Performance analysis: productivity and impact

The publication and citation trends of ECR between 2001 and 2020 are presented in Fig.  2 (RQ1). In terms of publication, the number of articles published in ECR has grown from 20 articles per year in 2001 to 81 articles per year in 2020, with an average annual growth rate of 7.64%. In terms of citations, the number of citations that ECR articles received has grown from three citations in 2001 to 1219 citations in 2020, with an average annual growth rate of 37.19%. These statistics suggest that ECR ’s publications and citations have seen exponential growth since its inception, and that the journal’s citations have grown at a much faster rate than its publication, which is very positive.

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig2_HTML.jpg

Annual publication and citation structure of ECR

The most prolific authors in ECR between 2001 and 2020 are presented in Table ​ Table1 1 (RQ2). The most prolific author is Jian Mou, who has published six articles in ECR , which have garnered a total of 95 citations. This is followed by Yan-Ping Liu and Liyi Zhang, who have published three articles each in ECR , which have received a total of 46 and 42 citations, respectively. Among the top 20 contributors, the author with the highest citation average per publication is Katina Michael (TC/TP and TC/TCP = 59 citations), who is followed closely by Yue Guo (TC/TP and TC/TCP = 51 citations); they are the only two authors who have an average citation greater than 50 for their ECR articles.

Most prolific authors for ECR between 2001 and 2020

AuthorTPTCPTCTC/TPTC/TCP
Mou J659515.8319.004
Liu Y.-P334615.3315.333
Zhang L324214.0021.002
Lin Z334013.3313.333
Westland J.C33217.007.003
Luo X31196.3319.001
Yan B3262.003.001
Sun J3000.000.000
Michael K2211859.0059.002
Guo Y2210251.0051.002
Choo K.-K.R227839.0039.002
Khedmatgozar H.R227437.0037.002
Wei J227336.5036.502
Teng C.-I227135.5035.502
Paraschiv C226733.5033.502
Chen M.-Y226331.5031.502
Cohen J226130.5030.502
Maes P225628.0028.002
Tsao W.-C225527.5027.502
Lee H.S225025.0025.002

TP = total publication(s). TCP = total cited publication(s). TC = total citation(s). TC/TP = cites per publication. TC/TCP = cites per cited publication. h  =  h -index

Institutions

The most prolific institutions for ECR between 2001 and 2020 are presented in Table ​ Table2 2 (RQ2). IBM, with 14 articles and 371 citations, emerges as the highest contributing institution to ECR . It is surprising yet encouraging to see a high number of contributions coming from practice, which reflects the ECR ’s receptiveness to publish industry-relevant research. Nonetheless, it is worth mentioning that this contribution is derived from the collective effort of IBM’s research labs around the world (e.g., Delhi, Haifa, and New York)—a unique advantage that most higher education institutions do not enjoy unless they have full-fledged research-active international branch campuses around the world. The second and third most contributing institutions are Nanjing University and Xi’an Jiaotong University, with 11 and 10 articles that have been cited 116 and 29 times, respectively. This is yet another interesting observation, as the contributions by Chinese institutions suggest that ECR is a truly international journal despite its origins and operations stemming in the United States. Finally, the University of California (TC/TP and TC/TCP = 34.86 citations) emerges as the institution that averages the most citations per publication, followed by IBM (TC/TP and TC/TCP = 26.50 citations) and Texas Tech University (TC/TP and TC/TCP = 26.20 citations).

Most prolific institutions for ECR between 2001 and 2020

InstitutionTPTCPTCTC/TPTC/TCP
IBM141437126.5026.509
Nanjing University11711610.5516.574
Xi'an Jiaotong University107292.904.143
Zhejiang University98859.4410.635
Xidian University86567.009.334
Shanghai University82162.008.002
University of California7724434.8634.867
University of Texas769413.4315.674
Wuhan University75689.7113.604
Hefei University of Technology7281.144.002
Queensland University of Technology6613823.0023.004
Tsinghua University64579.5014.254
South China University of Technology64447.3311.003
Soochow University66406.676.673
University of Illinois66315.175.174
Texas Tech University5513126.2026.205
University of Wisconsin559919.8019.804
Victoria University of Wellington559018.0018.004
City University of Hong Kong555410.8010.804
University of Alabama55295.805.804

The most prolific countries in ECR between 2001 and 2020 are presented in Table ​ Table3 3 (RQ2). China emerges as the most prolific contributor, with 152 articles and 1066 citations. This is followed by the United States, which has contributed 143 articles and 2813 citations. No country other than China and the United States has contributed more than 50 articles to ECR . Nevertheless, it is important to note that ECR also receives contributions from many countries around the world, as the remaining ± 50% of contributions in the top 20 list comes from 18 different countries across Asia, Europe, and Oceania.

Most prolific countries for ECR between 2001 and 2020

CountryTPTCPTCTC/TPTC/TCP
China15210810667.019.8715
United States143133281319.6721.1523
Taiwan353453515.2915.7412
South Korea342645113.2617.357
Australia302854718.2319.5413
Germany212056526.9028.259
United Kingdom211841319.6722.9411
India21151637.7610.876
Spain201832116.0517.8312
Greece171751230.1230.1211
Hong Kong16131428.8810.928
Canada151250633.7342.1710
France131121816.7719.829
Italy131118614.3116.918
Switzerland111125022.7322.739
Iran111122220.1820.187
New Zealand101016716.7016.708
Japan878710.8812.435
Singapore7721530.7130.715
Sweden667913.1713.174

The most cited articles in ECR between 2001 and 2020 are presented in Table ​ Table4 4 (RQ3). The most cited article published in ECR during this period is Füller et al.’s [ 26 ] article on the role of virtual communities in new product development (TC = 270). This is followed by Sotiriadis and van Zyl’s [ 27 ] article on electronic word of mouth and its effects on the tourism industry (TC = 188), Nonnecke et al.’s [ 28 ] article on the phenomena of ‘lurking’ in online communities (TC = 185), Lehdonvirta’s [ 29 ] article on the factors that drive virtual product purchases (TC = 170), and Bae and Lee’s [ 30 ] article on the effect of gender on consumer perception of online reviews (TC = 125). The diversity of topics in the most cited articles indicate that electronic commerce is indeed a multi-faceted subject, which we will explore in detail in the later sections.

Most cited articles published in ECR between 2001 and 2020

Author(s)TitleYearTCC/Y
Füller J., Bartl M., Ernst H., Mühlbacher, HCommunity based innovation: how to integrate members of virtual communities into new product development200627018.00
Sotiriadis M.D., van Zyl CElectronic word-of-mouth and online reviews in tourism services: the use of Twitter by tourists201318823.50
Nonnecke B., Andrews D., Preece JNon-public and public online community participation: needs, attitudes and behavior200618512.33
Lehdonvirta VVirtual item sales as a revenue model: identifying attributes that drive purchase decisions200917014.17
Bae S., Lee TGender differences in consumers’ perception of online consumer reviews201112512.50
Kim J.BAn empirical study on consumer first purchase intention in online shopping: integrating initial trust and TAM201212413.78
Zarmpou T., Saprikis V., Markos A., Vlachopoulou MModeling users’ acceptance of mobile services201212113.44
Sila IFactors affecting the adoption of B2B e-commerce technologies201311814.75
Malaga R.AWeb-based reputation management systems: problems and suggested solutions20011185.90
Gregg D.G., Walczak SThe relationship between website quality, trust and price premiums at online auctions20101049.45
Huang T.-L., Liao SA model of acceptance of augmented-reality interactive technology: the moderating role of cognitive innovativeness201510217.00
Flanagin A.J., Metzger M.J., Pure R., Markov A., Hartsell EMitigating risk in ecommerce transactions: perceptions of information credibility and the role of user-generated ratings in product quality and purchase intention201410114.43
Lee P.MBehavioral model of online purchasers in e-commerce environment20021015.32
Guo Y., Barnes SVirtual item purchase behavior in virtual worlds: an exploratory investigation2009978.08
Pourshahid A., Amyot D., Peyton L., Ghanavati S., Chen P., Weiss M., Forster A.JBusiness process management with the user requirements notation2009968.00
Hsieh J.-K., Hsieh Y.-C., Tang Y.-CExploring the disseminating behaviors of eWOM marketing: persuasion in online video2012808.89
Xu F., Michael K., Chen XFactors affecting privacy disclosure on social network sites: an integrated model2013799.88
Patton M.A., Josang ATechnologies for trust in electronic commerce2004794.65
Taylor D.G., Davis D.F., Jillapalli RPrivacy concern and online personalization: the moderating effects of information control and compensation2009766.33
Jeffrey S.A., Hodge RFactors influencing impulse buying during an online purchase2007745.29

TC = total citation(s). C/Y = cites per year

Publication outlets

The publication outlets that have cited ECR articles the most between 2001 and 2020 are presented in Table ​ Table5 5 (RQ4). The list includes many prestigious journals such as International Journal of Information Management (ABDC = A*, IF = 8.210), Information and Management (ABDC = A*, IF = 5.155), and Decision Support Systems (ABDC = A*, IF = 4.721), among others. The presence of such reputed journals reflects ECR ’s own reputation of high standing among its peers. Apart from ECR , the publication outlets that have highly cited ECR include Lecture Notes in Computer Science including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics (TC = 218), Computers in Human Behavior (TC = 95), and ACM International Conference Proceeding Series (TC = 88), which reflect the diversity in publication outlets that ECR is making an impact (e.g., book, conference, journal).

Publications citing ECR the most between 2001 and 2020

tTitleTCABDC rankIFCiteScoreSNIP
Electronic Commerce Research267A2.5074.31.962
Lecture Notes in Computer Science including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics218NANANANA
Computers in Human Behavior95A5.00312.13.079
ACM International Conference Proceeding Series88NANA0.80.333
Journal of Retailing and Consumer Services69A4.2197.42.166
Sustainability67NA2.567NANA
Electronic Commerce Research and Applications61C3.8246.91.787
Advances in Intelligent Systems and Computing60NANA0.90.429
Lecture Notes in Business Information Processing51NANA1.30.573
Internet Research47A4.7087.92.213
Journal of Business Research44A4.8748.92.76
International Journal of Information Management43A*8.2114.13.773
Decision Support Systems43A*4.7219.52.718
IEEE Access41NA3.7453.91.734
Information and Management38A*5.155113.002
Communications in Computer and Information Science37NANA0.70.403
Ceur Workshop Proceedings31NANA0.60.293
Journal of Electronic Commerce Research30B1.87540.963
Industrial Management and Data Systems30A3.3297.92.502
Telematics and Informatics29C4.1399.72.566
Journal of Internet Commerce29BNA3.71.203
Expert Systems with Applications29C5.452113.139

TC = total citation(s). ABDC rank = Australian Business Deans Council rank. IF = 2019 impact factor by Clarivate Analytics. SNIP = 2019 source normalized impact per paper by Scopus. NA = not available

Co-authorship analysis: scientific network

Co-authorship.

The co-authorships in ECR between 2005 and 2020 are presented in Table ​ Table6 6 (RQ5). On the one hand, the co-authorship analysis shows that the share of articles written by a single author has gone down over the years from 10.94% (2005–2008) to 8.61% (2017–2020). The small and decreasing share of single-authored articles do not come as a surprise given the importance and proliferation of collaboration to address increasing thematic and methodological complexity in research [ 31 ]. On the other hand, the co-authorship analysis shows that multi-authored articles have increased their share in ECR , especially articles with three authors or more. In particular, the share of articles with three and five or more authors have increased from 31.25% and 4.69% between 2005 and 2008 to 34.45% and 14.35% between 2017 and 2020, respectively. These statistics suggests that collaboration is growing in prominence, which is consistent with recent observations reported by other premier journals in business [ 32 – 34 ], and that ECR is a good home for collaborative research.

Authors per paper per period

Number of authors2005–2008 (%)2009–2012 (%)2013–2016 (%)2017–2020 (%)Total (%)
110.9417.8112.248.6111.26
232.8135.6227.5523.4427.70
331.2532.8834.6934.4533.78
420.315.4814.2919.1415.99
 ≥ 54.698.2211.2214.3511.26

Network centrality

The most important authors, institutions, and countries across different measures of centrality are presented in Table ​ Table7 7 (RQ6). In this study, we employ four measures of centrality: degree of centrality, betweenness centrality, closeness centrality, and eigen centrality.

Centrality measures for authors, institutions, and countries

RankDegree of centralityBetweenness centralityCloseness centralityEigen centrality
Author
1Mou JMou JLuo XWang J.-X
2Sun JSun JZhang LChan F.T.S
3Lin ZDing ZYan BAmyot D
4Ding ZLuo XWang QChen P
5Luo XZhang LChen KYang L
6Wang QYan BWestland J.CWang T
7Zhang LWang QLi XChoo K.-K.R
8Yan BChen KZhang NWeiss M
9Chen KZheng HFan WChen J.-K
10Zheng HWestland J.CKim JShi Y
Institution
1Renmin UniversityRenmin UniversityUniversity of OttawaUniversity of Ottawa
2University of OttawaXidian UniversityUniversity of Electronic Science and Technology of ChinaIBM
3Xidian UniversityCity University of Hong KongYonsei UniversityRenmin University
4University of AlabamaChinese Academy of SciencesNanjing UniversityZhejiang University
5Zhejiang UniversityUniversity of OttawaBeihang UniversityHefei University of Technology
6Hefei University of TechnologyBeijing Institute Of TechnologySeoul National UniversityCity University of Hong Kong
7University of TexasUniversity of IllinoisNational Cheng Kung UniversityUniversity of Electronic Science and Technology of China
8Tsinghua UniversityWuhan UniversityNational Taichung UniversityYonsei University
9IBMSoochow UniversityUniversity of the Basque CountryXi'an Jiaotong University
10City University of Hong KongKookmin UniversityUniversity of NottinghamWuhan University
Country
1United StatesChinaUnited StatesUnited States
2ChinaUnited StatesSpainVenezuela
3SpainSpainNorwayUnited Kingdom
4United KingdomGreeceIranSlovenia
5AustraliaGermanyBelgiumSouth Korea
6GreeceItalyCzech RepublicNorway
7GermanyFranceNetherlandsSwitzerland
8ItalyUnited KingdomSingaporeNew Zealand
9South KoreaNorwayIndiaItaly
10New ZealandSouth KoreaTurkeySpain

In essence, degree of centrality refers to the number of relational ties a node has in a network. In contrast, betweenness centrality refers to a node’s ability to connect otherwise unconnected groups of nodes, wherein nodes act as a gateway for the flow of information. Whereas, closeness centrality refers to a node’s closeness to every other node in the network, whereby nodes that reflect a greater number of shortest paths than others in a network indicates the ability of those nodes to transmit information and knowledge across the network with relative ease. Finally, eigen centrality refers to a node’s relative importance in a network, whereby nodes that are connected to other highly connected nodes are crucial to information transfer.

In terms of authors, Jian Mou emerged as the most important author for degree of centrality and betweenness centrality, whereas Xin Luo and Jian-xin Wang were flagged as the most important authors for closeness centrality and eigen centrality, respectively. In terms of institutions, Renmin University emerged as the most important institution for degree centrality and betweenness centrality, whereas the University of Ottawa was rated as the most important institution for closeness centrality and eigen centrality. In terms of countries, China emerged as the most important country for betweenness centrality, whereas the United States emerged as the most important country for the other three measures of centrality. Collectively, these findings indicate the most important constituents for degree of centrality, betweenness centrality, closeness centrality, and eigen centrality in terms of authors, institutions, and countries.

Collaboration network

The author collaboration network in Fig.  3 indicates that authors groups in ECR are fairly separated from each other, especially among highly connected authors (more than five links in the network). This suggests that most authors in ECR chose to work in a single team rather than across multiple teams. The institution collaboration network in Fig.  4 reaffirms our earlier finding that Renmin University is indeed the most important constituent of the network, especially among highly connected institutions (more than five links in the network). The institution collaboration network also appears to be more complex than the author collaboration network, wherein institutions appear to be far more connected to each other, indicating a good degree of collaboration across institutional lines. The country network in Fig.  5 presents a similar network scenario, where countries appear to be fairly well connected, with the United States being at the center of the country-level collaboration network. These findings suggest that ECR authors collaborate more actively across institutions and countries than teams.

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig3_HTML.jpg

Author co-authorship network. Note Threshold for inclusion is five or more links in the network

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig4_HTML.jpg

Institution co-authorship network. Note Threshold for inclusion is five or more links in the network

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig5_HTML.jpg

Country co-authorship network. Note Threshold for inclusion is five or more links in the network

Bibliographic coupling: thematic clusters

Bibliographic coupling is applied to unpack the major clusters (themes) within the ECR corpus. The method is predicated on the assumption that documents that share the same references are similar in content [ 18 , 35 ]. The application of bibliographic coupling on 443 ECR articles resulted in the formation of 30 clusters, wherein 11 major clusters were identified. The 11 major clusters, which contained 401 (or 90.5%) ECR articles, were ordered based on number of publications and average publication years, with more recent clusters ordered before older clusters in the case of clusters sharing the same number of publications. The summary of the 11 major clusters, which take center stage in this study, is presented in Table ​ Table8 8 .

Summary of major clusters

Cluster #Cluster themeTPTCAPYMost cited articles
AuthorTitleYearTC
1Online privacy and security749632013.09Zarmpou T., Saprikis V., Markos A., Vlachopoulou MModeling users’ acceptance of mobile services2012121
Chaudhry S.A., Farash M.S., Naqvi H., Sher MA secure and efficient authenticated encryption for electronic payment systems using elliptic curve cryptography201653
Antoniou G., Batten LE-commerce: protecting purchaser privacy to enforce trust201147
2Online channels and optimization494512016.67Jeffrey S.A., Hodge RFactors influencing impulse buying during an online purchase200774
Biller S., Chan L.M.A., Simchi-Levi D., Swann JDynamic pricing and the direct-to-customer model in the automotive industry200562
Yan RProfit sharing and firm performance in the manufacturer-retailer dual-channel supply chain200843
3Online engagement and preferences499822013.98Nonnecke B., Andrews D., Preece JNon-public and public online community participation: needs, attitudes and behavior2006185
Sila IFactors affecting the adoption of B2B e-commerce technologies2013118
Ozok A.A., Wei JAn empirical comparison of consumer usability preferences in online shopping using stationary and mobile devices: results from a college student population201069
4Online market sentiments and analyses411982018.56Zhou QMulti-layer affective computing model based on emotional psychology201863
Suki N.MConsumer shopping behaviour on the Internet: insights from Malaysia201319
Chen Y., Mullen T., Chu C.-HAn in-depth analysis of information markets with aggregate uncertainty200616
5Online reviews and ratings406112017.28Bae S., Lee TGender differences in consumers’ perception of online consumer reviews2011125
Flanagin A.J., Metzger M.J., Pure R., Markov A., Hartsell EMitigating risk in ecommerce transactions: Perceptions of information credibility and the role of user-generated ratings in product quality and purchase intention2014101
Fairlie R.WExplaining differences in access to home computers and the Internet: a comparison of Latino groups to other ethnic and racial groups200734
6Online exchanges and transactions343202011.29Narayanasamy K., Rasiah D., Tan T.MThe adoption and concerns of e-finance in Malaysia201139
Dumas M., Aldred L., Governatori G., Ter Hofstede A.H.MProbabilistic automated bidding in multiple auctions200527
Marinč MBanks and information technology: Marketability vs. relationships201325
7Online media and platforms306682016.23Sotiriadis M.D., van Zyl CElectronic word-of-mouth and online reviews in tourism services: the use of Twitter by tourists2013188
Huang T.-L., Liao SA model of acceptance of augmented-reality interactive technology: the moderating role of cognitive innovativeness2015102
Hsieh J.-K., Hsieh Y.-C., Tang Y.-CExploring the disseminating behaviors of eWOM marketing: persuasion in online video201280
8Online technology acceptance and continuance262492016.37Zhou TAn empirical examination of user adoption of location-based services201342
Chen Q., Chen H.-M., Kazman RInvestigating antecedents of technology acceptance of initial ECRM users beyond generation X and the role of self-construal200734
Royo S., Yetano A“Crowdsourcing” as a tool for e-participation: two experiences regarding CO2 emissions at municipal level201522
9Online communities and commercialization in the virtual world227712012.23Füller J., Bartl M., Ernst H., Mühlbacher HCommunity based innovation: How to integrate members of virtual communities into new product development2006270
Lehdonvirta VVirtual item sales as a revenue model: Identifying attributes that drive purchase decisions2009170
Guo Y., Barnes SVirtual item purchase behavior in virtual worlds: An exploratory investigation200997
10Online customer expectations, satisfaction, and loyalty182912016.11Hanafizadeh P., Khedmatgozar H.RThe mediating role of the dimensions of the perceived risk in the effect of customers’ awareness on the adoption of Internet banking in Iran201263
Valvi A.C., Fragkos K.CCritical review of the e-loyalty literature: a purchase-centred framework201260
Aloudat A., Michael KToward the regulation of ubiquitous mobile government: a case study on location-based emergency services in Australia201139
11Online purchase intention186712014.00Kim J.BAn empirical study on consumer first purchase intention in online shopping: integrating initial trust and TAM2012124
Gregg D.G., Walczak SThe relationship between website quality, trust and price premiums at online auctions2010104
Taylor D.G., Davis D.F., Jillapalli RPrivacy concern and online personalization: the moderating effects of information control and compensation200976

Cluster #1: online privacy and security

Cluster #1 contains 74 articles that have been cited 963 times with an average publication year of 2013.09. The most cited article in this cluster is Zarmpou et al.’s [ 36 ] article on the adoption of mobile services. This is followed by Chaudhry et al.’s [ 37 ] article on user encryption schemes for e-payment systems, and Antoniou and Batten’s [ 38 ] article on purchaser’s privacy and trust in online transactions. Other articles in this cluster have considered topics such as e-commerce trust models [ 39 ], consumer privacy [ 40 ], cybercrime and cybersecurity issues [ 41 ], gender differences [ 42 ], and the development and implementation of various authentication systems [ 43 , 44 ]. Thus, ECR articles in this cluster appear to be centered on online privacy and security issues , including equivalent solutions for improved authentication and encryption to improve trust in electronic commerce.

Cluster #2: online channels and optimization

Cluster #2 contains 49 articles that have been cited 415 times with an average publication year of 2016.67. The most cited article in this cluster is Jeffrey and Hodge’s [ 45 ] article on impulse purchases in online shopping. This is followed by Biller et al.’s [ 46 ] article on dynamic pricing for online retailing in the automotive industry, and Yan’s [ 47 ] article on profit sharing and firm performance in manufacturer-retailer dual-channel supply chains. Other articles in this cluster have examined online channels such as peer-to-peer networks and social commerce [ 48 , 49 ] and optimal supply chain configuration [ 50 , 51 ]. Thus, ECR articles in this cluster appear to be concentrated on online channels and optimization , particularly in terms of the channel characteristics and price and supply chain optimization in electronic commerce.

Cluster #3: online engagement and preferences

Cluster #3 contains 49 articles that have been cited 982 times with an average publication year of 2013.98. The most cited article in this cluster is Nonnecke et al.’s [ 28 ] article on online community participation. This is followed by Sila’s [ 52 ] article on business-to-business electronic commerce technologies, and Ozok and Wei’s [ 53 ] article on consumer preferences of using mobile and stationary devices. Other articles in this cluster have explored topics such as online community participation and social impact across countries [ 54 ], online opinions across regions and its impact on consumer preferences [ 55 , 56 ], content and context factors [ 57 ], data mining techniques [ 58 ], and recommender systems and their application in online environments [ 59 , 60 ]. Thus, ECR articles in this cluster appear to be focused on online engagement and preferences , including the adoption and usage of technology (e.g., data mining, recommender systems) to curate engagement and shape preferences among target customers in electronic commerce.

Cluster #4: online market sentiments and analyses

Cluster #4 contains 41 articles that have been cited 198 times. This cluster has the highest average publication year among the 11 major clusters (2018.56), which indicates that most articles in this cluster are fairly recent. The most cited article in this cluster is Zhou’s [ 61 ] article on multi-layer affective modeling of emotions in the online environment. This is followed by Suki’s [ 62 ] article on online consumer shopping insights, and Chen et al.’s [ 63 ] article on information markets. Other articles in this cluster have investigated topics such as Internet queries and marketplace prediction [ 64 ], cross-border electronic commerce using the information systems success model [ 65 ], and electronic [ 66 ] and social [ 67 ] commerce using big data. Thus, ECR articles in this cluster appear to be centered on online market sentiments and analyses , with the use of advanced modeling techniques to unpack fresh insights on electronic commerce being relatively prominent.

Cluster #5: online reviews and ratings

Cluster #5 contains 40 articles that have been cited 611 times with an average publication year of 2017.28. The most cited article in this cluster is Bae and Lee’s [ 30 ] article on online consumer reviews across gender. This is followed by Flanagin et al.’s [ 68 ] article on user-generated online ratings, and Fairlie’s [ 69 ] on the digital divide in online access, which speaks to the technological infrastructure required to post and respond to online reviews and ratings. Other articles in this cluster have examined quantitative and qualitative feedback in online environments [ 70 ], electronic word of mouth platforms and persuasiveness [ 71 ], online reviews and product innovation [ 72 ] , recommender systems and product ranking [ 73 ], and online rating determinants [ 74 ]. Thus, ECR articles in this cluster appear to be concentrated on online reviews and ratings , including its potential differences among consumers coming from different demographic backgrounds.

Cluster #6: online exchanges and transactions

Cluster #6 contains 34 articles that have been cited 320 times with an average publication year of 2011.29. The most cited article in this cluster is Narayanasamy et al.’s [ 75 ] article on the adoption and concerns of e-finance. This is followed by Dumas et al.’s [ 76 ] article on bidding agents in e-auction, and Marinč’s [ 77 ] article on the impact of information technology on the banking industry. Other articles in this cluster have explored topics such as game theoretic aspects of search auctions [ 78 ], auction mechanism for ad space among advertisers [ 79 ], trust analysis in online procurement [ 80 ], efficiency of reverse auctions [ 81 ], and effect of hedonic and utilitarian behaviors on the e-auction behavior [ 82 ]. Thus, ECR articles in this cluster appear to be focused on online exchanges and transactions , particularly in terms of auction mechanisms and banking-related services.

Cluster #7: online media and platforms

Cluster #7 contains 30 articles that have been cited 668 times with an average publication year of 2016.23. The most cited article in this cluster is Sotiriadis and van Zyl’s [ 27 ] article on social media in the form of Twitter. This is followed by Huang and Liao’s [ 83 ] article on augmented reality interactive technology, and Hsieh et al.’s [ 84 ] article on online video persuasion in electronic commerce. Other articles in this cluster have investigated topics such as the role of social media in disseminating product information [ 85 ], the effect of video formats on person-to-person streaming [ 86 ], interpersonal relationship building using social media [ 87 ], and microblog usage [ 88 ]. Thus, ECR articles in this cluster appear to be centered on online media and platforms , particularly in terms of its variation, use, and impact in shaping consumer behavior in electronic commerce.

Cluster #8: online technology acceptance and continuance

Cluster #8 contains 26 articles that have been cited 244 times with an average publication year of 2016.37. The most cited article in this cluster is Zhou’s [ 89 ] article on the adoption of location-based services. This is followed by Chen et al.’s [ 90 ] article on the adoption of electronic customer relationship management, and Royo and Yetano’s [ 91 ] article on crowdsourcing usage in local governments. Other articles in this cluster have examined topics such as gender discrimination in online peer-to-peer lending [ 92 ], continued usage of e-auction services [ 93 ], and investor trust in peer-to-peer lending platforms [ 94 ]. Thus, ECR articles in this cluster appear to be concentrated on online technology acceptance and continuance , including determinants and discriminants that explain online technology-mediated behavior across different forms of electronic commerce such as e-auction, e-lending, e-government, and e-customer relationship management.

Cluster #9: online communities and commercialization in the virtual world

Cluster #9 contains 22 articles that have been cited 771 times with an average publication year of 2012.23. The most cited article in this cluster is Füller et al.’s [ 26 ] article on the role of virtual communities in new product development. This is followed by Lehdonvirta’s [ 29 ] article on the revenue model of virtual products, and Guo and Barnes’s [ 95 ] article on the purchase behavior of virtual products. Other articles in this cluster have investigated topics such as metaverse retailing [ 96 ], issues faced by developers of virtual worlds [ 97 ], the impact of virtual world on e-business models [ 98 ], e-commerce transactions in virtual environments [ 99 ], and customer value co-creation in virtual environments [ 26 ]. Thus, ECR articles in this cluster appear to be focused on the online communities and commercialization in the virtual world , particularly in virtual environments such as online gaming.

Cluster #10: online customer expectations, satisfaction, and loyalty

Cluster #10 contains 18 articles that have been cited 291 times with an average publication year of 2016.11. The most cited article in this cluster is Hanafizadeh and Khedmatgozar’s [ 100 ] article on consumer expectations of risk in online banking. This is followed by Valvi and Fragkos’s [ 101 ] article on purchase-centered e-loyalty, and Aloudat and Michael’s [ 102 ] article on regulatory expectations of ubiquitous mobile government. Other articles in this cluster have examined topics such as continued usage of e-services [ 103 ], determinants of e-loyalty [ 104 ] , risk expectations of e-services [ 105 ], and e-service quality implications for customer satisfaction and loyalty [ 106 ]. Thus, ECR articles in this cluster appear to be centered on online customer expectations, satisfaction, and loyalty , particularly in e-service settings such as online banking.

Cluster #11: online purchase intention

Cluster #11 contains 18 articles that have been cited 671 times with an average publication year of 2014.00. The most cited article in this cluster is Kim’s [ 107 ] article on online purchase intention using trust theory and technology acceptance model. This is followed by Gregg and Walczak’s [ 108 ] article on the effects of website quality on online purchase intention, and Taylor et al.’s [ 109 ] article on the effects of privacy concerns on online purchase intention. Other articles in this cluster have explored topics that either reaffirm the findings of the highly cited articles in this cluster, such as privacy concerns and personalization [ 109 , 110 ], or that extend the breadth of cluster coverage, such as store image [ 111 ], risk, and trust [ 112 ] as determinants of online purchase intention. Thus, ECR articles in this cluster appear to be concentrated on online purchase intentions , particularly in terms of its multi-faceted determinants that avail or transpire in electronic commerce.

Temporal keyword analysis: thematic evolution

Building on the thematic clusters uncovered using bibliographic coupling (see Fig.  6 ), this study performs a temporal keyword analysis to unpack the development of themes and its evolutionary trajectory in ECR over time.

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig6_HTML.jpg

Period wise publication trend in major clusters. Note Cluster #1 = online privacy and security. Cluster #2 = online channels and optimization. Cluster #3 = online engagement and preferences. Cluster #4 = online market sentiments and analyses. Cluster #5 = online reviews and ratings. Cluster #6 = online exchanges and transactions. Cluster #7 = online media and platforms. Cluster #8 = online technology acceptance and continuance. Cluster #9 = online communities and commercialization in the virtual world. Cluster #10 = online customer expectations, satisfaction, and loyalty. Cluster #11 = online purchase intention

Thematic development from 2005 to 2008

Most ECR articles between 2005 and 2008 appear in Clusters #1, #3, and #6 (see Fig.  6 ), which indicate research concentration on online privacy and security, online engagement and preferences, and online exchanges and transactions. The keyword network in Fig.  7 confirms this observation. Apart from general keywords such as “e-commerce,” keywords such as “cryptography,” “privacy,” and “security” relate directly to the theme of Cluster #1, which is about online privacy and security. The prominence of the word “cryptography” indicates the popularity and importance of the topic during this period. Other keywords such as “auctions,” “online auctions,” and “bidding strategies” relate to the theme of Cluster #6, which is about online exchanges and transactions, with particular focus on online auction and banking. Other keywords such as “collaborative filtering,” “online communities,” and “mobile commerce” relate to the theme of Cluster #3, which is about online engagement and preferences. The bigger and bolder keywords observed in Clusters #1 and #3 suggest that the direct benefits and costs of electronic commerce were most pertinent in the early stages of ECR , with the augmented aspects of electronic commerce in Cluster #6 emerging closely behind the two leading clusters in this period.

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig7_HTML.jpg

Keyword network between 2005 and 2008. Note Threshold for inclusion is a minimum of two occurrences

Thematic development from 2009 to 2012

Most ECR articles between 2009 and 2012 are located in Cluster #1 (see Fig.  6 ), which reveal the continued pertinence of research concentrating on online privacy and security during this period. Nonetheless, ECR experienced a substantial growth in research focusing on online media and platforms, online communities and commercialization in the virtual world, online customer expectations, satisfaction, and loyalty, and online purchase intention, as seen through ECR articles in Clusters #7, #9, #10, and #11 during this period. The keyword network in Fig.  8 adds to this observation. In particular, keywords such as “security,” “payment protocol,” and “trust management” relate to the theme of Cluster #1 on online privacy and security, whereas keywords such as “metaverses,” “second life,” “virtual reality,” and “virtual world” speak to the emergence of online communities and commercialization in the virtual world characterizing Cluster #9. Similarly, keywords such as “reputation” and “trust” are important to online customer expectations, satisfaction, and loyalty (Cluster #10) and their online purchase intention (Cluster #11). Interestingly, though Cluster #7 emerged during this period, we did not observe any unique or specific keywords relating to this cluster, which may be attributed to online media and platform research early focus on its “adoption,” a keyword that we felt resonates more with Cluster #8.

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig8_HTML.jpg

Keyword network between 2009 and 2012. Note Threshold for inclusion is a minimum of two occurrences

Thematic development from 2013 to 2016

Most ECR articles between 2013 and 2016 continue to be situated in Cluster #1 (see Fig.  6 ), which suggest the continued pertinence of research concentrating on online privacy and security during this period. Nonetheless, there are a number of clusters that saw noteworthy growth, such as Clusters #2, #5, #7, #8, and #10, which indicate that research attention has also been invested in topics related to online channels and optimization, online reviews and ratings, online media and platforms, online technology acceptance and continuance, and online customer expectations, satisfaction, and loyalty. The keyword network in Fig.  9 supports this observation. More specifically, keywords such as “personal information” and “privacy” indicate continued research in Cluster #1, though it appears that the focus has shifted from authentication and security mechanisms to privacy matters, which may be attributed to the rise of personalized and targeted online marketing activities (e.g., tracking of user activity for personalized advertisements). Whereas, keywords such as “B2C e-commerce” and “e-government” denote emerging interest in online channels and optimization (Cluster #2), “electronic word of mouth” indicates growing interest in online reviews and ratings (Cluster #5), “cloud computing,” “IPTV,” and “social media” reveal increasing interest in online media and platforms (Cluster #7), “information technology,” “technology adoption,” and “technology acceptance model” speak to research on online technology acceptance and continuance (Cluster #8), and “product type,” “quality of service,” and “user satisfaction” resonate with research on online customer expectations, satisfaction, and loyalty (Cluster #10).

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig9_HTML.jpg

Keyword network between 2013 and 2016. Note Threshold for inclusion is a minimum of two occurrences

Thematic development from 2017 to 2020

Most ECR articles between 2017 and 2020 are located in Cluster #4 (see Fig.  6 ), which reflect the noteworthy emergence and shift of research concentration from online privacy and security to online market sentiments and analyses. Other thematic clusters such as Clusters #2, #3, and #5 have also witnessed a massive increase in publications during this period. This implies that ECR has become relatively diverse in the research that it publishes, which also explains the rise in the number of papers that the journal publishes during this period. The keyword network in Fig.  10 sheds further light on this observation. In particular, many keywords in the network illustrate a strong research concentration on online market sentiments and analyses, such as “big data,” “data mining,” machine learning,” “sentiment analysis,” and “social network analysis” (Cluster #4). Similarly, keywords such as “dual channel supply chain,” “supply chain coordination,” and “social commerce” indicate the type of research focusing on online channels and optimization (Cluster #2), “social influence,” “social media,” and “social media marketing” reflect research in the area of online engagement and preferences (Cluster #3), and “consumer reviews,” “online reviews,” “reputation,” and “word of mouth” speak to research on online reviews and ratings (Cluster #5).

An external file that holds a picture, illustration, etc.
Object name is 10660_2021_9464_Fig10_HTML.jpg

Keyword network between 2017 and 2020. Note Threshold for inclusion is a minimum of two occurrences

This study presents a 20-year retrospective of ECR since its inception in 2001. Several research questions were proposed and pursued using a bibliometric methodology consisting of performance analysis and science mapping (e.g., co-authorship analysis, bibliographic coupling, and temporal keyword analysis).

Our first four research questions—i.e., research question 1 to research question 4—concentrated on the publication and citation trends of ECR . Through performance analysis, we found that ECR has grown exponentially in terms of its publications and citations. Most contributors of ECR come from China and the United States, which reflect (1) China’s standing as the world’s largest e-commerce market with 50 percent of the world’s online transactions occurring in this country, and (2) the United States’ standing as the world’s pioneer of e-commerce (e.g., Amazon) and her expectation for e-commerce to reach 50% of total retail sales in the country in 10 years [ 113 ]. Interestingly, IBM, a non-academic institution, emerged as the highest contributing institution to the journal, which is unsurprising given that IBM is the largest industrial research organization in the world with 12 research labs across six continents [ 114 ]. More importantly, ECR was found to be well received among its peers, with many of its citations coming from prestigious journals in the field of information systems and management. Nevertheless, we observed that ECR receives very little contribution from Africa and several parts of Asia, particularly South Asia and South East Asia. Though electronic commerce may not have been very prominent in these regions in the past, we believe that the coronavirus pandemic that has taken the world by storm in 2020 has accelerated the proliferation and adoption of electronic commerce in these regions, and thus, we would encourage authors from these regions to submit their best papers to ECR in the near future. Thus, we raise two future research questions (FRQs) for exploration:

FRQ1: What are the e-commerce innovations that avail in underexplored regions (e.g., Africa, South Asia, and South East Asia) and how do such innovations fare in terms of similarities and differences in manifestations and impact against their more richly explored counterparts (e.g., China, United States)?

FRQ2: How can global pandemics such as COVID-19 change or impact e-commerce around the world (e.g., can the pandemic accelerate e-commerce adoption across all layers of society; can the pandemic lead to new innovations; can e-commerce contribute to positive and/or negative economic and social impact during the pandemic—and if yes, what and how, and if no, why)?

Our next two research questions—i.e., research question 5 and research question 6—focused on the collaboration trends in and the important constituents of ECR in the co-authorship network. Using co-authorship analysis, we found that the collaboration culture in ECR has grown with the passage of time, as evidenced through the decreasing share of single-authored articles and the increasing share of multi-authored publications, especially in the five or more authors category. We also observed that the share of multi-authored articles has always been dominant in the journal, with such publications forming nearly 90% of the corpus at any given point in time. Indeed, these observations reflect the increasing emphasis that universities place on multi-author and inter-/multi-/trans-disciplinary collaborations in promotion and tenure practices and policies [ 115 ]. In terms of important constituents in the co-authorship network, Jian Mou emerged as the most important author across two measures of centrality, whereas Renmin University and University of Ottawa emerged as the most important institutions at the institution level, and the United States emerged as the most important constituent at the country level. Nonetheless, we noted that authors who collaborate in ECR do not work much across diverse teams, but they do, however, work a lot across institutions and countries. Future scholars could rely on the centrality networks that we have curated herein this study for potential collaboration with authors from varying institutions and countries who have a good publication record and a research interest to publish with ECR .

Our final research question—i.e., research question 7—was dedicated to unpacking the major themes in ECR . Through bibliographic coupling, our study found 11 major clusters that reflected the major themes underpinning research published in ECR : (1) online privacy and security, (2) online channels and optimization, (3) online engagement and preferences, (4) online market sentiments and analyses, (5) online reviews and ratings, (6) online exchanges and transactions, (7) online media and platforms, (8) online technology acceptance and continuance, (9) online communities and commercialization in the virtual world, (10) online customer expectations, satisfaction, and loyalty, and (11) online purchase intention. Through temporal keyword analysis, our study observed that the topics published in ECR has become more diverse over time, with a noteworthy shift from an early concentration on online privacy and security to a contemporary focus on newer, industry-informed topics, such as online market sentiments and analyses, which we reckon coincides with the emergence of the unique peculiarities of the fourth industrial revolution (IR 4.0), such as big data and machine learning, in recent years [ 116 , 117 ]. Thus, to extend the line of research that concentrates on unpacking the contemporary realities of e-commerce, we propose another two future research questions (FRQs) for exploration:

FRQ3: How can emergent technologies (e.g., artificial intelligence, big data analytics, blockchain, machine learning) be applied to improve forecasting (e.g., cybercrime, social network), optimize functions (e.g., advertising, sales), and protect stakeholders (e.g., privacy, security) in e-commerce?

FRQ4: How can e-commerce operators leverage on emergent technologies to acquire competitive advantages (e.g., how to build trust and good relationships with customers [e.g., digital natives, digital migrants], and how to respond to changes in customer demands and marketplace trends with agility), and whether these competitive advantages that they acquired are sustainable or transient (and if transient, then what can they do to curate, maintain, or replenish their competitive advantages in the long run)?

Though thorough in its approach, this study does suffer from certain limitations. First, this study relies on the Scopus for bibliometric data. Though the database has its merits, as laid out in the methodology section, the bibliographic data is not created for the purpose of bibliometric analysis. This may lead to errors in the data source. Through data cleaning, we have attempted to minimize errors, but any remaining error in the source data, which we might have missed, could have an impact on the final analysis, though we believe that the margin for such errors would be relatively small, if not, negligible. Second, ECR has been around for 20 years, but the dataset available on Scopus, which we used, is only complete for 16 years (2005–2020). Due to this limitation, the science mapping part of the study—i.e., co-authorship, bibliographic coupling, and temporal keyword analysis—had to be restricted to this period only. We do not discount the possibility that the complete set of earlier data (2001–2004) may become available on Scopus in the future, and thus, we would encourage future research aiming to conduct a bibliometric review for ECR , perhaps in the next milestone (e.g., 30, 40, or 50 years), to check on such data availability, and if available, to take advantage and conduct a full-fledged science mapping for the journal. Finally, the scientific insights that could be uncovered through a bibliometric methodology, though rich, remain limited. In particular, bibliometric reviews such as ours do not delve into expert information, such as the theories, contexts, and methods employed to create new knowledge on electronic commerce in the ECR corpus. This, in turn, makes it difficult for bibliometric reviews to put forth a comprehensive set of data-informed proposals for future research. Nonetheless, we opine that bibliometric reviews do provide a good starting point of data-informed insights that future research can rely on to understand the trajectory of the extant discussion of electronic commerce in the journal. In particular, we believe that such insights would be useful, not only for future empirical research (e.g., potential collaboration networks, research themes of interest), but also for future reviews on thematic domains in ECR (e.g., systematic reviews on online market sentiments), which can be done in a number of ways, such a critical review [ 118 – 120 ], a thematic review [ 121 , 122 ], a theory-driven review [ 123 ], a method-driven review [ 124 , 125 ], or a framework-based review [ 126 ].

Compliance with ethical standards

On behalf of all authors, the corresponding author states that there is no conflict of interest.

1 Web of Science single-year and five-year impact factors for ECR : https://www.springer.com/journal/10660 .

2 Scopus CiteScore and SNIP for ECR : https://www.scopus.com/sourceid/145669 .

Contributor Information

Satish Kumar, Email: [email protected] .

Weng Marc Lim, Email: moc.cramgnew@mil , Email: ua.ude.niws@milcram , Email: ym.ude.enrubniws@milw .

Nitesh Pandey, Email: ni.ca.tinm@6109MBR8102 .

J. Christopher Westland, Email: ude.ciu@dnaltsew .

Information

  • Author Services

Initiatives

You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.

All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .

Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.

Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.

Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.

Original Submission Date Received: .

  • Active Journals
  • Find a Journal
  • Proceedings Series
  • For Authors
  • For Reviewers
  • For Editors
  • For Librarians
  • For Publishers
  • For Societies
  • For Conference Organizers
  • Open Access Policy
  • Institutional Open Access Program
  • Special Issues Guidelines
  • Editorial Process
  • Research and Publication Ethics
  • Article Processing Charges
  • Testimonials
  • Preprints.org
  • SciProfiles
  • Encyclopedia

jtaer-logo

Journal Menu

  • Aims & Scope
  • Editorial Board
  • Instructions for Authors
  • Special Issues
  • Sections & Collections
  • Article Processing Charge
  • Indexing & Archiving
  • Most Cited & Viewed
  • Journal Statistics
  • Journal History
  • Society Collaborations
  • Editorial Office

Journal Browser

  • arrow_forward_ios Forthcoming issue arrow_forward_ios Current issue
  • Vol. 19 (2024)
  • Vol. 18 (2023)
  • Vol. 17 (2022)
  • Vol. 16 (2021)
  • Volumes not published by MDPI
  • Vol. 15 (2020)
  • Vol. 14 (2019)
  • Vol. 13 (2018)
  • Vol. 12 (2017)
  • Vol. 11 (2016)
  • Vol. 10 (2015)
  • Vol. 9 (2014)
  • Vol. 8 (2013)
  • Vol. 7 (2012)
  • Vol. 6 (2011)
  • Vol. 5 (2010)
  • Vol. 4 (2009)
  • Vol. 3 (2008)
  • Vol. 2 (2007)
  • Vol. 1 (2006)

Find support for a specific problem in the support section of our website.

Please let us know what you think of our products and services.

Visit our dedicated information section to learn more about MDPI.

Open Access and Article Processing Charge (APC)

All articles published in Journal of Theoretical and Applied Electronic Commerce Research (ISSN 0718-1876) are published in full open access . An article processing charge (APC) of CHF 1000 (Swiss Francs) applies to papers accepted after peer review. This article processing charge is to cover the costs of peer review, copyediting, typesetting, long-term archiving, and journal management. In addition to Swiss francs (CHF), we also accept payment in euros (EUR), US dollars (USD), British pound sterling (GBP), Japanese yen (JPY) or Canadian dollars (CAD).

Invoices are emailed shortly after acceptance to the payment contact provided by the authors. Only official invoices issued by MDPI (@mdpi.com) are valid. We do not authorize any third party to collect the APCs. MDPI is the sole service provider and cannot be held liable for actions by third parties.

Local VAT or Sales Tax will be added if applicable.

For more detailed information on how to pay an invoice, please see our Payment Instructions .

Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions. Note that many national and private research funding organizations and universities explicitly cover APCs for articles resulting from funded research projects. Discounts are also available for authors from institutes which participate in MDPI's Institutional Open Access Program ( IOAP ).

  • Article Processing Charges (APC) Information
  • Open Access Information and Policy
  • Information for Authors
  • Accepted Methods of Payment
  • Pay an Invoice Now
  • MDPI Invoicing FAQ

Further Information

Mdpi initiatives, follow mdpi.

MDPI

Subscribe to receive issue release notifications and newsletters from MDPI journals

  • DOI: 10.1007/978-3-319-50091-1
  • Corpus ID: 168662352
  • Introduction to Electronic Commerce and Social Commerce
  • E. Turban , J. Whiteside , +1 author Jon Outland
  • Published 4 May 2017
  • Computer Science, Business

68 Citations

E-commerce application (q-kart), an overview of electronic commerce (e-commerce), an analysis of the impact, problems, and challenges of digital platforms for e-commerce marketing, marketing and technologies platforms in smart f-store, igniting social commerce: using instagram for mobile retail shopping.

  • Highly Influenced

Understanding global e-commerce development during the COVID-19 pandemic: Technology-Organization-Environment perspective

A bibliometric analysis of platform research in e-commerce: past, present, and future research agenda, critical factors in indonesia's e-commerce collaboration, factors influencing the purchase decision through social commerce channels: the results of mixed research in moscow, instagram shopping in saudi arabia: what influences consumer trust and purchase decisions, related papers.

Showing 1 through 3 of 0 Related Papers

IEEE Account

  • Change Username/Password
  • Update Address

Purchase Details

  • Payment Options
  • Order History
  • View Purchased Documents

Profile Information

  • Communications Preferences
  • Profession and Education
  • Technical Interests
  • US & Canada: +1 800 678 4333
  • Worldwide: +1 732 981 0060
  • Contact & Support
  • About IEEE Xplore
  • Accessibility
  • Terms of Use
  • Nondiscrimination Policy
  • Privacy & Opting Out of Cookies

A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. © Copyright 2024 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.

Journal of Electronic Commerce Research

Regular Issue

  • Consumer Responses to Online Advertising and Online Reviews: The Mediating Role of Cognitive Responses and Affective Responses
  • Do Mhealth Apps Influence Consumers’ Safe Food Choice Decisions? Role of Technology Affordances
  • Promotion Regulatory Fit or Prevention Regulatory Fit, Which Is the King on Social Media? Influence of Social Identification on Brand Loyalty
  • Attention to Product Images in an Online Retailing Store: An Eye-Tracking Study Considering Consumer Goals and Type of Product

Most Viewed Articles

  • Content Analysis Of Social Media: A Grounded Theory Approach
  • Customer Willingness To Pay For Online Music: The Role Of Free Mentality
  • Pre-Purchase Online Information Seeking: Search Versus Browse
  • Consumer Responses To Brands Placed In Youtube Movies: The Effect Of Prominence And Endorser Expertise
  • Optimal Reserve Price For The Generalized Second-Price Auction In Sponsored Search Advertising
  • Providing Information And Enabling Transactions: Which Website Function Is More Important For Success?

Recommended Articles

  • Investigating Collaborative Commerce System from the Perspective of Collaborative Relationship
  • Cultural Adaptation In Cross Border E-Commerce: A Study Of German Companies
  • Investigating Common Method Bias via an EEG Study of the Flow Experience in Website Design

Investigating LLM Applications in E-Commerce

The emergence of Large Language Models (LLMs) has revolutionized natural language processing in various applications especially in e-commerce. One crucial step before the application of such LLMs in these fields is to understand and compare the performance in different use cases in such tasks. This paper explored the efficacy of LLMs in the e-commerce domain, focusing on instruction-tuning an open source LLM model with public e-commerce datasets of varying sizes and comparing the performance with the conventional models prevalent in industrial applications. We conducted a comprehensive comparison between LLMs and traditional pre-trained language models across specific tasks intrinsic to the e-commerce domain, namely classification, generation, summarization, and named entity recognition (NER). Furthermore, we examined the effectiveness of the current niche industrial application of very large LLM, using in-context learning, in e-commerce specific tasks. Our findings indicate that few-shot inference with very large LLMs often does not outperform fine-tuning smaller pre-trained models, underscoring the importance of task-specific model optimization.Additionally, we investigated different training methodologies such as single-task training, mixed-task training, and LoRA merging both within domain/tasks and between different tasks. Through rigorous experimentation and analysis, this paper offers valuable insights into the potential effectiveness of LLMs to advance natural language processing capabilities within the e-commerce industry.

1. Introduction

Large Language Models (LLMs) have recently gained ubiquitous use in many domains (Singhal et al . , 2022 ; Trautmann et al . , 2022 ; Malinka et al . , 2023 ) . In the e-commerce domain in particular, LLMs have the potential to facilitate the creation of product descriptions, summarize reviews, expand queries, and answer buyer and seller questions, among other potential use cases.

We simulated a common practice in the e-commerce industry: adapting open source state of the art models for domain specific tasks. We compared the feasibility of using an LLM and explored to what extent using an LLM for different e-commerce tasks leads to gains in the evaluation metrics. Training LLMs from scratch requires a significant amount of resources, but a common practice to efficiently train the model is to use parameter efficient methods like low rank adapters (LoRA) (Hu et al . , 2021 ) . Important questions arise when attempting to adapt these models for specific tasks and domains. We attempt to answer in this work: How much training data is needed to adapt a model to a task? How much do LLMs outperform more traditional approaches? What ways do different tasks interact with each other when doing mixed dataset training or merging LoRA weights trained on indivudal tasks? There are various approaches for adapting LLMs for tasks in a specific domain. Specifically, we focus on LoRA supervised fine-tuning (SFT), multi-task training, zero-shot inference, and LoRA merging.

Our contributions are as follows: 1) Organizing and formatting four e-commerce datasets for the evaluation of large language models (LLMs). 2) Conducting comprehensive experiments to compare fine-tuning a large language model with conventional industrial baselines, such as BERT and T5, using varying amounts of data for e-commerce tasks; additionally, we examine the effectiveness of in-context learning with a highly competitive, very large LLM. 3) Exploring the use of mixed LoRA merging across different tasks and comparing this approach to traditional mixed dataset training.

Our findings indicate that for e-commerce-specific tasks, conventional methods, such as training smaller language models, can achieve performance that is comparable to or even surpasses that of general-purpose very large LLMs. These valuable insights provide for the application of these models within the e-commerce industry.

2. Background

Large Language Models (LLMs) (Chowdhery et al . , 2023 ; OpenAI et al . , 2023 ; Anil et al . , 2023 ; Almazrouei et al . , 2023 ; Touvron et al . , 2023 ) have seen increasing attention in recent years as models that perform natural language generation have begun to be used for multiple tasks. They differ from prior pre-trained language models (PLMs), such as BERT (Devlin et al . , 2019 ) or T5 (Raffel et al . , 2020 ) , in their amount of training data and number of parameters.

2.1. Instruction Fine-tuning

Instruction fine-tuning represented a pivotal advancement in the optimization of large language models (LLMs), such as GPT-4, for enhanced task-specific performance, especially in domain-specific applications (Hu et al . , 2023 ; Zhang et al . , 2024 ) . This method involved the supplementary training of a pre-trained based model such as GPT (OpenAI et al . , 2023 ) , Llama (Touvron et al . , 2023 ) , or Falcon (Almazrouei et al . , 2023 ) on a task specific dataset consisting of prompts paired with their optimal responses. The objective was to refine the model’s capacity to comprehend and execute instructions with increased accuracy and contextual relevance. Instruction fine-tuning has emerged as an invaluable technique for augmenting the proficiency of LLMs across various specialized domains, ensuring their outputs align more closely with user expectations and requirements.

2.2. Low-Rank Adaptation Training

Low-Rank Adaptation (LoRA) (Hu et al . , 2021 ) is an innovative technique designed to fine-tune (LLMs) in a resource-efficient manner. This method addresses the challenge of adapting pre-trained models to specialized tasks without the extensive computational costs associated with traditional full-model fine-tuning. At the heart of LoRA is the strategic introduction of trainable low-rank matrices that target specific components of the LLM’s architecture, namely the attention and feed-forward neural network layers inherent to the transformer model. Specifically, it freezes the pre-trained layers of the LLM, and for each layer, it trains a rank-decomposition matrix and injects them into each layer of the pre-trained model to accomplish the LLM fine-tuning.

𝐖 𝐀 superscript 𝐁 𝑇 \mathbf{W}^{\prime}=\mathbf{W}+\mathbf{A}*\mathbf{B}^{T} bold_W start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT = bold_W + bold_A ∗ bold_B start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT , where 𝐖 ′ superscript 𝐖 ′ \mathbf{W}^{\prime} bold_W start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT represents the adapted weights. This process selectively fine-tunes the model, allowing it to acquire new capabilities or improve performance on specific tasks with minimal adjustments to its pre-trained parameters. This selective updating is particularly beneficial for domain-specific applications, where only certain aspects of the model’s knowledge need refinement.

2.3. Evaluation

With the rise of text generation models that are seemingly capable of performing large numbers of tasks and able to answer many questions, a number of evaluation strategies have been proposed. Evaluation leaderboards often consist of evaluation tasks like Hellaswag (Zellers et al . , 2019 ) , MMLU (Hendrycks et al . , 2021b ) , and others (Gao et al . , 2023 ; Hendrycks et al . , 2021b , a ) which cover a broad range of multiple choice questions. These types of multiple choice question evaluations, where the answer is chosen based on the choice with the highest likelihood can be brittle as rankings can be sensitive to minute details (Alzahrani et al . , 2024 ) . Other evaluation benchmarks like GLUE (Wang et al . , 2018 ) consist of a bundle of different tasks with task specific evaluation metrics. Another approach to evaluating LLM performance is the approach of LLM as a judge. Chatbot arena (Zheng et al . , 2024 ) is an example of this style of evaluation and while it can correlate with human judgment, like other LLM applications it can be subject to hallucinations. In this work, we focus on directly evaluating the tasks of interest with existing scoring practices.

2.4. LLMs for E-commerce

Zhang et al . ( 2024 ) find that fine-tuning LLM scaling factors appear to be very task dependent; however, there has been little published work examining fine-tuning focusing on the e-commerce domain. There has been some prior work investigating the use of LLMs on e-commerce tasks. ECOMGPT (Li et al . , 2023 ) looked at framing e-commerce tasks as instruction fine tuning, but doesn’t explore LoRA (Hu et al . , 2021 ) or how different tasks enhance or interfere with each other or the amount of data required for reasonable performance.

3. E-Commerce Datasets

There are a limited number of e-commerce datasets publicly available. Currently, there are few e-commerce benchmarks for evaluating LLMs on e-commerce tasks. We collected four datasets covering classification, sequence labeling, and product description generation, and review summarization in order to evaluate the performance of LLMs in the e-commerce domain.

Task Train Dev Test
ESCI Classification 1,393,063 - 425,762
QueryNER: Query Segmentation 7,841 871 933
Review Summarization 25,203 3,114 3,166
Description Generation 431,470 - 103,865

3.1. ESCI Multi-class Product Classification

The Shopping Queries ESCI dataset (Reddy et al . , 2023 ) contains search queries, released with the aim of fostering research in the area of semantic matching of queries and products. The dataset contains three tasks: Query-Product Ranking, Multi-Class Product Classification, Product Substitute Identification. We use the ESCI Multi-Class Product Classification task. The task is to classify a query and product pair as an exact match (E), a substitute (S), a complementary product (C) or Irrelevant (I). Because Query-Product Ranking and Product Substitute Identification involve more complexity and longer input strings, we do not include them for LLM evaluation in this work.

3.2. QueryNER

QueryNER (Palen-Michel et al . , 2024 ) is an e-commerce query segmentation dataset. The task in QueryNER is not to extract aspects, but rather to segment the user’s query into meaningful chunks. QueryNER uses a subset of the Amazon Shopping Queries Dataset (Reddy et al . , 2023 ) as the underlying data. QueryNER consists of an ontology of 17 types. The entity types are: core_product_type, product_name, product_number, modifier, creator, condition, unit of measurement (UoM), department, material, time, content, color, shape, quantity, occasion, origin, and price.

Because QueryNER uses BIO encoding ( B for begin, I for inside a span, O for outside a span), we linearized the data in order to have an input prompt and output string. The formatting of the linearized data is a series of (token, label) pairs.

3.3. Review Summarization

AMASUM (Bražinskas et al . , 2021 ) is a dataset for summarizing product reviews. The product reviews are in English and come from bestreviews.com, cnet.com, pmag.co.uk, runrepeat.com, which mainly consist of electronics and running shoes reviews. The dataset contains a list of product reviews and a summary with the “verdict” on the product and also lists of pros and cons. The original paper focuses on selecting useful reviews in order to summarize.

The goal of our evaluation of LLM performance is not to assess its review selection capability, so we select a small number of reviews to summarize. We select only 4 reviews to be used to generate the verdict summary. Since the dataset has a field with helpful votes where users voted that the review was helpful, we take the top four reviews with the most helpful votes as our selection process.

3.4. Product Description Generation

There appears to be a lack of standard benchmark datasets in English for product description generation despite a decent amount of prior work. Koto et al . ( 2022 ) stated they were not able to release the dataset due to copyright issues. Chan et al . ( 2019 ) and Zhang et al . ( 2019 ) collected data from Taobao 1 1 1 https://www.taobao.com/ . Zhang et al . ( 2019 ) also stated that there was no other standard dataset for product description generation. Wang et al . ( 2017 ) created their dataset from attribute values and descriptions from Amazon but only in the category ”Computers and Tablets”.

Without a clear prior benchmark for this task, we create a simple product description task from the ESCI Shopping Queries Dataset (Reddy et al . , 2023 ) . We assemble an input consisting of a product title, brand, color, and bullet points. The bullet points in the original dataset are aspect-value pair information about a product or short snippets about the product. The expected output is the product description. We filter out items where there is no title, no description, no bullet points, or items where the description is an exact match of the title or bullet points.

3.5. Task Alignment & Prompt Design

To enable instruction fine-tuning, each individual dataset was required to be aligned to a sequence to sequence style task in order to be used with an LLM. Review summarization and product description generation already were easily treated as sequence to sequence tasks. However it was less obvious how to best treat classification and sequence labeling tasks. We treated the classification label as text to be generated. For sequence labeling, the model was expected to output tuples of each token along with its label.

Prompts were designed to provide the model with enough context to accomplish its task. We created task specific templates for each of the tasks. Each prompt asked the model to act as an e-commerce expert to provide context. The prompt then gave a brief description of the task and along with the training example. Examples of prompts are shown in Appendix Appendix .

4. Experiments

4.1. baselines.

We chose to use the most common and competitive baselines for each e-commerce task. For classification tasks, ESCI Task 2 and QueryNER, we chose to use BERT (BERT-base) (Devlin et al . , 2019 ) as the baseline model with a learning rate of 3e-5 following Devlin et al . ( 2019 ) . The training of BERT followed the conventional formulation of the sequence classification problem for the ESCI task and token classification for the QueryNER task.

For generative tasks, review summarization, and product description generation, we chose to use T5 (T5-base) (Raffel et al . , 2020 ) as a baseline model. T5 and BERT are fine-tuned with default parameters released by Hugging face (Wolf et al . , 2020 ) . Because in-context learning has been shown to be effective (Dong et al . , 2024 ) , we use we include Mixtral 8 x 22b (Jiang et al . , 2024 ) as a theoretical state of the art zero-shot and few-shot baseline.

4.2. Mix Tasks Training

Mixing tasks (datasets) for fine-tuning large language models (LLMs) can enhance the model’s performance, generalization ability, and adaptability to various tasks, which closely mirrors the industrial application. The trained model was not required to accomplish one task but rather several domain-specific tasks such as query named entity recognition (NER), text summarization, description generation, and classification. Fine-tuning LLMs with mixed and diverse training datasets could help improve performance on each task.

4.3. Mix LoRA Merging

𝐖 1 𝑛 superscript subscript 𝑖 0 𝑛 1 subscript 𝐀 𝑖 superscript subscript 𝐁 𝑖 𝑇 \mathbf{W}^{\prime}=\mathbf{W}+\frac{1}{n}\sum_{i=0}^{n-1}\mathbf{A}_{i}% \mathbf{B}_{i}^{T} bold_W start_POSTSUPERSCRIPT ′ end_POSTSUPERSCRIPT = bold_W + divide start_ARG 1 end_ARG start_ARG italic_n end_ARG ∑ start_POSTSUBSCRIPT italic_i = 0 end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_n - 1 end_POSTSUPERSCRIPT bold_A start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT bold_B start_POSTSUBSCRIPT italic_i end_POSTSUBSCRIPT start_POSTSUPERSCRIPT italic_T end_POSTSUPERSCRIPT . Mixing LoRA merging provided additional flexibility since additional tasks could be added later instead of retraining whenever a new task was added. Additionally, some types of tasks may benefit each other, while others may lower another tasks performance when merged. Mixing LoRA merge enabled more efficient experimentation with different combinations of tasks compared with directly training with the mixed data set.

4.4. Implementation Details

The foundation model used in all LoRA fine-tuning experiments was Llama-2-7b as its moderate size and considerable performance on various tasks (Touvron et al . , 2023 ) . The supervised fine-tune was conducted with 3 3 3 3 epochs for each dataset, as we do not see performance gain while we trained it longer. Since all four tasks for the LLM were formulated as a text generation task (see Section 3.5 ), we followed the most common hyperparameters to finetune the LLM under the text generation setup. Specifically, the model was loaded with 8 8 8 8 bit, the max length of input was set to 1500 1500 1500 1500 , and the precision of the parameter was set to be bf16 . During the supervised fine-tune, we adopted the LoRA (Hu et al . , 2021 ) to conduct efficient model training. The LoRA α 𝛼 \alpha italic_α was set to be 16 16 16 16 , with dropout rate be 0.05 0.05 0.05 0.05 . The initial learning rate was chosen to be 3 ⁢ e − 5 3 𝑒 5 3e-5 3 italic_e - 5 with a cosine learning rate scheduler. To further improve the training efficiency, we adopted paged_adamw_8bit as optimizer. The LLM model training were conducted on two NVIDIA A100 80GB GPUs.

To optimize computational time, we randomly sampled subsets from each dataset for our experiments. Specifically, for the ESCI dataset, we used samples of 5k, 10k and 50k as the training set and sampled 1k from the original test set to serve as the test set. For the QueryNER dataset, we selected 1k, 5k, and 8k (full 7,841 data samples) samples for training and used the entire original test set as the test set. In the case of the description generation dataset, we randomly chose 1k, 5k, 10k, and 25k samples for training, with 10k samples from the original test set used as the test set. Finally, for the Review Summarization dataset, we sampled 1k, 5k, 10k, and 25k (the entire 25,203 dataset) as the training set and utilized the complete original test set as the test set. All experiments were conducted using the same aforementioned hyperparameters.

5.1. Metrics on different tasks

Since the datasets we explored contained both classification and generative tasks, we use the task-specific metric to evaluate the performance of the model performance on various datasets. For classification tasks, we use F1 score as evaluation metrics and report both micro-average and macro-average results, while for the generative task, we use the Rouge-1 F1 (Rouge-1) and Rouge-L F1 (Rouge-L) (Lin and Och, 2004 ) to evaluate the performance.

5.2. Evaluating LLM on Classification Tasks

To ensure accurate mapping of the generated text to the actual class label in the classification task, we implemented a simple but strict evaluation approach. For ESCI classification, the LLM output was required to match the corresponding label exactly. Any deviation from the exact label resulted in the classification being considered incorrect. For QueryNER, labels were extracted using a regular expression expecting a list of tuples of tokens with BIO tags. If the LLM output deviated from the expected output, the labels were considered all O s (no entities identified). Because we noticed the model sometimes being inconsistent with the output format, the regular expression also handles comma separated output without parentheses. In the case of further formatting issues or when the model does not predict labels for all tokens, it is assumed the model failed to generate a valid label sequence and that particular example is assigned all O s. Palen-Michel et al . ( 2021 ) highlighted issues with NER scoring. For scoring procedure clarity, once the model output has been extracted from the linearized form, we use seqeval (Nakayama, 2018 ) for evaluation using the setting which is equivalent with conlleval.

5.3. SFT LLMs vs Baseline PLMs

We performed SFT training of Llama2-7b on each dataset with different portions of the data to explore the impact of training data size for fine-tuning an LLM on each task.

5.3.1. Classification tasks

ESCI Classification QueryNER
Micro F1 Macro F1 Micro F1 Macro F1
BERT @5k 0.348 0.181 @1k 0.539 0.390
LLM SFT @5k 0.355 0.244 @1k 0.280 0.156
BERT @10k 0.628 0.294 @5k 0.580 0.508
LLM SFT @10k 0.397 0.213 @5k 0.553 0.398
BERT @50k 0.629 0.368 @8k 0.603 0.569
LLM SFT @50k 0.628 0.294 @8k 0.626 0.579
Mixtral 0-shot 0.571 0.199 0.145 0.063
Mixtral 3-shot 0.537 0.009 0.484 0.336

Table 2 shows the performance comparison on classification tasks on ESCI Classification and QueryNER dataset among Llama2-7b Supervised fine-tuning, BERT model fine-tuning and in context learning using Mixtral 8 x 22b in zero and few-shot setup. Note that, instead of generating the distribution like BERT, the task for the LLM is to generate the classification result in text. As the number of the training samples increased the performance of the model generally increased. However, there was a clear performance boost of LLM as the number of training samples increased (from 10k to 50k on ESCI task 2 dataset and from 1k to 5k on Query NER dataset). In general, the LLM and BERT performed comparable in these classification tasks when given sufficient training data.

In domain-specific tasks such as ESCI classification and Query NER, the application of in-context learning with very large language models like the Mixtral 8x22b often does not meet the performance benchmarks achieved through fine-tuning. Despite the introduction of extensive context, these models frequently struggle to deliver the level of accuracy required for industrial applications. This observation underscores a critical limitation: while LLMs are versatile and powerful, they may not be inherently optimized for tasks that demand high precision within a specialized domain.

In contrast, fine-tuning enables models to be specifically tailored to the intricacies of the task at hand, allowing for a deeper understanding of domain-specific patterns and nuances. As a result, training smaller, task-specific models such as BERT, particularly those employing a softmax classification layer, often emerges as a more effective strategy. These models not only demonstrate superior performance but also offer advantages in computational efficiency, making them more suitable for deployment in resource-constrained industrial environments where both accuracy and efficiency are paramount.

5.3.2. Generation task

Review Summarization Desc. Generation
Rouge-1 Rouge-L Rouge-1 Rouge-L
T5 @1k 0.155 0.137 0.239 0.216
LLM SFT @1k 0.158 0.147 0.262 0.244
T5 @5k 0.162 0.147 0.241 0.223
LLM SFT @5k 0.182 0.161 0.249 0.232
T5 @10k 0.163 0.150 0.238 0.221
LLM SFT @10k 0.186 0.162 0.258 0.241
T5 @25k 0.169 0.158 0.232 0.215
LLM SFT @25k 0.187 0.165 0.237 0.222
Mixtral 0-shot 0.099 0.090 0.248 0.229
Mixtral 3-shot 0.144 0.131 0.274 0.254

Table 3 shows the performance comparison of text generation tasks on the review summarization and description generation datasets. Similar to the classification tasks, there was a significant increase in model performance as more data samples were used for training. Notably, the LLM consistently outperformed the conventional T5 model across both datasets. This superior performance can be attributed to the LLM’s larger model capacity and enhanced quality of pre-training.

Fine-tuned models (Llama2-7b and T5) outperformed the zero-shot capabilities of the much larger Mixtral 8x22B model in review summarization, while for description generation, the performance is comparable. Despite the Mixtral model’s strong standing on LLM leaderboards like (Fourrier et al . , 2024 ) , which suggests competitive summarization abilities, the observed performance gap between zero-shot and few-shot scenarios highlights a key limitation: without in-context guidance, the model struggles to achieve sufficient capability on domain-specific tasks (Review Summarization). However, when in-context information is provided, the model demonstrated significantly improved outcomes. In review summarization, to achieve even higher levels of performance, task-specific training becomes crucial. Notably, even with smaller model architectures, fine-tuning can yield superior results (using Llama2-7b).

In contrast, the description generation task is more aligned with general-purpose text generation, where the model’s ability to understand and leverage general knowledge is the primary factor in determining performance. Consequently, in this task, larger models like Mixtral, equipped with in-context guidance, could achieve top-tier performance, even surpassing fine-tuned smaller models.

QueryNER Review Summ. Desc. Generation
Micro F1 Marco F1 Rouge-1 Rouge-L Rouge-1 Rouge-L
QueryNER @ 5k 0.553 0.398 - - - -
+ Summ. LoRA @ 5k 0.002 0.232 0.192 0.164 - -
+ Desc. Generation @ 5k 0.018 0.344 - - 0.251 0.233
ESCI Review Summ. Desc. Generation
ESCI @ 5k 0.355 0.244 - - - -
+ Summ. LoRA @ 5k 0.145 0.174 0.184 0.156 - -
+ Desc. Generation LoRA @ 5k 0.137 0.299 - - 0.239 0.221

5.4. LoRA Merge

We experimented with merging different pairs of LoRA weights for each pair of tasks. For this experiment, we used the LoRA weights from the 5k training set size. To merge the LoRA weights we took the average of the two. The results of merging LoRA weights, shown in Table 4 , demonstrated that when weights trained on a task requiring a more rigid structure in the output like ESCI classification or QueryNER, the performance on those tasks suffers. However, the performance of description generation and review summarization remained comparable with the performance from independent training with the same number of examples.

Upon reviewing model output, we found that at least a portion of this degradation in performance on the tasks requiring a more strict output format was attributable to the output formatting requirements. However, some of this apparent degradation may not truly be quite as bad as it appears.

In Section C of the appendix, we show an example of model output for the QueryNER task was shown where the model did in fact output BIO labels some of which are correct labels, but with formatting unrecognized by the scoring script.

5.5. Comparison with Mix Tasks Training

ESCI Class.
QueryNER
Review Sum.
Desc. Gen.

We merged the LoRA (Low-Rank Adaptation) weights from all four tasks for inference and performance analysis on each respective test set. The weights were chosen based on training with 5k samples from each dataset to ensure balanced information contribution. To establish a fair comparison between training with mixed data and mixing through LoRA weight merging, we trained the foundation model (Llama-2 7B) on 5k samples from each dataset, resulting in a total of 20k training samples, using the same hyperparameters as in the previous experiments.

The results, detailed in Table 5 , indicated that mixed dataset training resulted in lower performance compared to training each task independently. This performance decrease was attributed to the limited capacity of the LoRA adapter and the distinct nature of each task, which deteriorated the model’s ability to consistently produce outputs in the correct format especially in the classification tasks. Furthermore, the LoRA weight merging approach generally showed inferior performance compared to both mixed dataset training and independent task training. In mixed LoRA merging, classification tasks particularly suffered, with output format issues noted (see Section 4 ). However, for text generation tasks, the performance remained competitive.

6. Conclusion

In this paper, we explored the application potential of LLMs in addressing common e-commerce tasks, benchmarking against conventional industrial models like BERT and T5. We collected four e-commerce datasets, containing classification and text generation tasks, and adapted both task types to a text generation framework for LLMs. Our findings reveal that: (1) Zero-shot with a larger LLM is not a clear win and that smaller models fine-tuned on a specific task can have better task specific performance. (2) LLMs required a certain volume of training data to reliably produce the correct formats in classification tasks, yet they achieve competitive performance against the conventional BERT baseline and surpass the T5 baseline in text generation tasks. (3) Mix task training appears to perform slightly worse but comparable to independent training. (4) While LoRA merging for classification tasks did not consistently maintain output format, it demonstrated that merging in text generation tasks could still deliver competitive performance on individual tasks. (5) Few shot performance seems to be better than zero shot or fine tuning with very small amounts of data, but in all tasks except description generation, fine-tuning a model with enough data still performed better. Overall, we demonstrated that for specific tasks in the e-commerce domain, out-of-the box zero-shot LLM inference like our use of mixtral 8 x 22b does not outperform fine-tuning approaches on target tasks and there are opportunities for further exploration of adapting LLMs to the e-commerce domain.

  • Almazrouei et al . (2023) Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Mérouane Debbah, Étienne Goffinet, Daniel Hesslow, Julien Launay, Quentin Malartic, et al . 2023. The falcon series of open language models. arXiv preprint arXiv:2311.16867 (2023).
  • Alzahrani et al . (2024) Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay, Sultan Alrashed, Shaykhah Alsubaie, Yusef Almushaykeh, Faisal Mirza, Nouf Alotaibi, Nora Altwairesh, Areeb Alowisheq, M Saiful Bari, and Haidar Khan. 2024. When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards. arXiv:2402.01781 [cs.CL]
  • Anil et al . (2023) Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernandez Abrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vlad Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, Guy Gur-Ari, Steven Hand, Hadi Hashemi, Le Hou, Joshua Howland, Andrea Hu, Jeffrey Hui, Jeremy Hurwitz, Michael Isard, Abe Ittycheriah, Matthew Jagielski, Wenhao Jia, Kathleen Kenealy, Maxim Krikun, Sneha Kudugunta, Chang Lan, Katherine Lee, Benjamin Lee, Eric Li, Music Li, Wei Li, YaGuang Li, Jian Li, Hyeontaek Lim, Hanzhao Lin, Zhongtao Liu, Frederick Liu, Marcello Maggioni, Aroma Mahendru, Joshua Maynez, Vedant Misra, Maysam Moussalem, Zachary Nado, John Nham, Eric Ni, Andrew Nystrom, Alicia Parrish, Marie Pellat, Martin Polacek, Alex Polozov, Reiner Pope, Siyuan Qiao, Emily Reif, Bryan Richter, Parker Riley, Alex Castro Ros, Aurko Roy, Brennan Saeta, Rajkumar Samuel, Renee Shelby, Ambrose Slone, Daniel Smilkov, David R. So, Daniel Sohn, Simon Tokumine, Dasha Valter, Vijay Vasudevan, Kiran Vodrahalli, Xuezhi Wang, Pidong Wang, Zirui Wang, Tao Wang, John Wieting, Yuhuai Wu, Kelvin Xu, Yunhan Xu, Linting Xue, Pengcheng Yin, Jiahui Yu, Qiao Zhang, Steven Zheng, Ce Zheng, Weikang Zhou, Denny Zhou, Slav Petrov, and Yonghui Wu. 2023. PaLM 2 Technical Report. arXiv:2305.10403 [cs.CL]
  • Bražinskas et al . (2021) Arthur Bražinskas, Mirella Lapata, and Ivan Titov. 2021. Learning Opinion Summarizers by Selecting Informative Reviews. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing . Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, 9424–9442. https://doi.org/10.18653/v1/2021.emnlp-main.743
  • Chan et al . (2019) Zhangming Chan, Xiuying Chen, Yongliang Wang, Juntao Li, Zhiqiang Zhang, Kun Gai, Dongyan Zhao, and Rui Yan. 2019. Stick to the Facts: Learning towards a Fidelity-oriented E-Commerce Product Description Generation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) . Association for Computational Linguistics, Hong Kong, China, 4959–4968. https://doi.org/10.18653/v1/D19-1501
  • Chowdhery et al . (2023) Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al . 2023. Palm: Scaling language modeling with pathways. Journal of Machine Learning Research 24, 240 (2023), 1–113.
  • Devlin et al . (2019) Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) . Association for Computational Linguistics, Minneapolis, Minnesota, 4171–4186. https://doi.org/10.18653/v1/N19-1423
  • Dong et al . (2024) Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Jingyuan Ma, Rui Li, Heming Xia, Jingjing Xu, Zhiyong Wu, Baobao Chang, Xu Sun, Lei Li, and Zhifang Sui. 2024. A Survey on In-context Learning. arXiv:2301.00234 [cs.CL] https://arxiv.org/abs/2301.00234
  • Fourrier et al . (2024) Clémentine Fourrier, Nathan Habib, Alina Lozovskaya, Konrad Szafer, and Thomas Wolf. 2024. Open LLM Leaderboard v2. https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard .
  • Gao et al . (2023) Leo Gao, Jonathan Tow, Baber Abbasi, Stella Biderman, Sid Black, Anthony DiPofi, Charles Foster, Laurence Golding, Jeffrey Hsu, Alain Le Noac’h, Haonan Li, Kyle McDonell, Niklas Muennighoff, Chris Ociepa, Jason Phang, Laria Reynolds, Hailey Schoelkopf, Aviya Skowron, Lintang Sutawika, Eric Tang, Anish Thite, Ben Wang, Kevin Wang, and Andy Zou. 2023. A framework for few-shot language model evaluation. https://doi.org/10.5281/zenodo.10256836
  • Hendrycks et al . (2021a) Dan Hendrycks, Collin Burns, Steven Basart, Andrew Critch, Jerry Li, Dawn Song, and Jacob Steinhardt. 2021a. Aligning AI With Shared Human Values. Proceedings of the International Conference on Learning Representations (ICLR) (2021).
  • Hendrycks et al . (2021b) Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021b. Measuring Massive Multitask Language Understanding. Proceedings of the International Conference on Learning Representations (ICLR) (2021).
  • Hu et al . (2021) Edward J Hu, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al . 2021. LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations .
  • Hu et al . (2023) Zhiqiang Hu, Lei Wang, Yihuai Lan, Wanyu Xu, Ee-Peng Lim, Lidong Bing, Xing Xu, Soujanya Poria, and Roy Lee. 2023. LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing , Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 5254–5276. https://doi.org/10.18653/v1/2023.emnlp-main.319
  • Jiang et al . (2024) Albert Q. Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Emma Bou Hanna, Florian Bressand, Gianna Lengyel, Guillaume Bour, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock, Sandeep Subramanian, Sophia Yang, Szymon Antoniak, Teven Le Scao, Théophile Gervet, Thibaut Lavril, Thomas Wang, Timothée Lacroix, and William El Sayed. 2024. Mixtral of Experts. arXiv:2401.04088 [cs.LG] https://arxiv.org/abs/2401.04088
  • Koto et al . (2022) Fajri Koto, Jey Han Lau, and Timothy Baldwin. 2022. Can Pretrained Language Models Generate Persuasive, Faithful, and Informative Ad Text for Product Descriptions?. In Proceedings of the Fifth Workshop on e-Commerce and NLP (ECNLP 5) . Association for Computational Linguistics, Dublin, Ireland, 234–243. https://doi.org/10.18653/v1/2022.ecnlp-1.27
  • Li et al . (2023) Yangning Li, Shirong Ma, Xiaobin Wang, Shen Huang, Chengyue Jiang, Hai-Tao Zheng, Pengjun Xie, Fei Huang, and Yong Jiang. 2023. EcomGPT: Instruction-tuning Large Language Model with Chain-of-Task Tasks for E-commerce. arXiv preprint arXiv:2308.06966 (2023).
  • Lin and Och (2004) Chin-Yew Lin and Franz Josef Och. 2004. Automatic evaluation of machine translation quality using longest common subsequence and skip-bigram statistics. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL-04) . 605–612.
  • Malinka et al . (2023) Kamil Malinka, Martin Peresíni, Anton Firc, Ondrej Hujnák, and Filip Janus. 2023. On the educational impact of chatgpt: Is artificial intelligence ready to obtain a university degree?. In Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1 . 47–53.
  • Nakayama (2018) Hiroki Nakayama. 2018. seqeval: A Python framework for sequence labeling evaluation. https://github.com/chakki-works/seqeval Software available from https://github.com/chakki-works/seqeval.
  • OpenAI et al . (2023) OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al . 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023).
  • Palen-Michel et al . (2021) Chester Palen-Michel, Nolan Holley, and Constantine Lignos. 2021. SeqScore: Addressing Barriers to Reproducible Named Entity Recognition Evaluation. In Proceedings of the 2nd Workshop on Evaluation and Comparison of NLP Systems . Association for Computational Linguistics, Punta Cana, Dominican Republic, 40–50. https://doi.org/10.18653/v1/2021.eval4nlp-1.5
  • Palen-Michel et al . (2024) Chester Palen-Michel, Lizzie Liang, Zhe Wu, and Constantine Lignos. 2024. QueryNER: Segmentation of E-commerce Queries. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) , Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, and Nianwen Xue (Eds.). ELRA and ICCL, Torino, Italia, 13455–13470. https://aclanthology.org/2024.lrec-main.1178
  • Raffel et al . (2020) Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research 21, 1 (2020), 5485–5551.
  • Reddy et al . (2023) Chandan Reddy, Nurendra Choudhary, Lluis Marquez, Fran Valero, Nikhil Rao, Hugo Zaragoza, Sambaran Bandyopadhyay, and Arnab Biswas. 2023. Shopping queries dataset: A large-scale ESCI benchmark for improving product search. arXiv preprint arXiv:2206.06588 . https://arxiv.org/pdf/2206.06588.pdf
  • Singhal et al . (2022) Karan Singhal, Shekoofeh Azizi, Tao Tu, S. Sara Mahdavi, Jason Wei, Hyung Won Chung, Nathan Scales, Ajay Tanwani, Heather Cole-Lewis, Stephen Pfohl, Perry Payne, Martin Seneviratne, Paul Gamble, Chris Kelly, Nathaneal Scharli, Aakanksha Chowdhery, Philip Mansfield, Blaise Aguera y Arcas, Dale Webster, Greg S. Corrado, Yossi Matias, Katherine Chou, Juraj Gottweis, Nenad Tomasev, Yun Liu, Alvin Rajkomar, Joelle Barral, Christopher Semturs, Alan Karthikesalingam, and Vivek Natarajan. 2022. Large Language Models Encode Clinical Knowledge. arXiv:2212.13138 [cs.CL]
  • Touvron et al . (2023) Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al . 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023).
  • Trautmann et al . (2022) Dietrich Trautmann, Alina Petrova, and Frank Schilder. 2022. Legal prompt engineering for multilingual legal judgement prediction. arXiv preprint arXiv:2212.02199 (2022).
  • Wang et al . (2018) Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. 2018. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP . Association for Computational Linguistics, Brussels, Belgium, 353–355. https://doi.org/10.18653/v1/W18-5446
  • Wang et al . (2017) Jinpeng Wang, Yutai Hou, Jing Liu, Yunbo Cao, and Chin-Yew Lin. 2017. A Statistical Framework for Product Description Generation. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers) . Asian Federation of Natural Language Processing, Taipei, Taiwan, 187–192. https://aclanthology.org/I17-2032
  • Wolf et al . (2020) Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander Rush. 2020. Transformers: State-of-the-Art Natural Language Processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations . Association for Computational Linguistics, Online, 38–45. https://doi.org/10.18653/v1/2020.emnlp-demos.6
  • Zellers et al . (2019) Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019. HellaSwag: Can a Machine Really Finish Your Sentence?. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics . Association for Computational Linguistics, Florence, Italy, 4791–4800. https://doi.org/10.18653/v1/P19-1472
  • Zhang et al . (2024) Biao Zhang, Zhongtao Liu, Colin Cherry, and Orhan Firat. 2024. When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method. arXiv:2402.17193 [cs.CL]
  • Zhang et al . (2019) Tao Zhang, Jin Zhang, Chengfu Huo, and Weijun Ren. 2019. Automatic generation of pattern-controlled product description in e-commerce. In The World Wide Web Conference . 2355–2365.
  • Zheng et al . (2024) Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al . 2024. Judging llm-as-a-judge with mt-bench and chatbot arena. Advances in Neural Information Processing Systems 36 (2024).

Appendix A Example samples from each Dataset

Task Prompt Input Response
ESCI Classification Query: revent 80 cfm Product: product_title: Panasonic FV-20VQ3 WhisperCeiling 190 CFM Ceiling Mounted Fan product_brand: Panasonic product_color: White product_bullet_point: WhisperCeiling fans feature a totally enclosed condenser motor and a double-tapered, dolphin-shaped bladed blower wheel to quietly move air Designed to give you continuous, trouble-free operation for many years thanks in part to its high-quality components and permanently lubricated motors which wear at a slower pace This Panasonic fan has a built-in damper to prevent backdraft, which helps to prevent outside air from coming through the fan 0.35 amp Irrelevant
QueryNER yarn swift carrying case (yarn, B-modifier), (swift, I-modifier), (carrying, B-core_product_type), (case, I-core_product_type)
Description Generation Title: Delta Electronics RAD80L BreezRadiance 80 CFM Heater/Fan/Light Combo White (Renewed) Brand: DELTA ELECTRONICS (AMERICAS) LTD. Color: White Bullet points: Quiet operation at 1.5 sones Built-in thermostat regulates temperature. Energy efficiency at 7.6 CFM/Watt Precision engineered with DC brushless motor for extended reliability, this fan will outlast many household appliances Galvanized steel construction resists corrosion Duct: Detachable 4-inch Plastic Duct Adapter This pre-owned or refurbished product has been professionally inspected and tested to work and look like new. How a product becomes part of Amazon Renewed, your destination for pre-owned, refurbished products: A customer buys a new product and returns it or trades it in for a newer or different model. That product is inspected and tested to work and look like new by Amazon-qualified suppliers. Then, the product is sold as an Amazon Renewed product on Amazon. If not satisfied with the purchase, renewed products are eligible for replacement or refund under the Amazon Renewed Guarantee.
Review Summarization I expected a lot more from this product. When something says it will ””thicken”” or give lots of body & fullness, most products deliver. This one does not. I have very fine thin hair & this barely gave me an ounce of body. Very disappointed & not worth the $. =(I purchased at a salon before. This bottle from Amazon, was not as thick. Like it had been watered down. I wouldn’t buy again. I was buying this at a local spa but they stopped stocking it so I did what every desperate person does-went to Amazon to see if they carried it. I’ve been using this product for years and it solves my thinning-hair problem perfectly with no stiffness and no nasty smell.My favorite blow dry gel. Soft and natural looking. Smells fresh and nice. A good budget spray gel option for those who want a quality hold without the higher price tag.

In Table 6 , an example from each dataset is shown.

Appendix B Prompt

Task Template
ESCI Classification Act as an e-commerce expert. Given a query and a related product retrieved for this query, the goal of this task is to classify the product as being an Exact, Substitute, Complement, or Irrelevant match for the query. Query: {The input query string} Product: {The product title} … Please answer with label “Exact”, “Substitute”, “Complement” or “Irrelevant” only.
QueryNER Act as an e-commerce expert. Identify the entities in the following query. Use BIO tagging format as if this is a named entity recognition or chunking task. The format should be tuples of the token followed by the tag. For example: (air, B-modifier), (tight, I-modifier), (containers, B-core_product_type), (for, B-modifier), (food, I-modifier). The entity types are: UoM, color, condition, content, core_product_type, creator, department, material, modifier, occasion, origin, price, product_name, product_number, quantity, shape, time Query: {The input query string}
Descr. Generation Act as an e-commerce expert. Given the following information about a product, generate a description for the product. Title: {Product Title} Brand: {Brand} Color: {Color} Bullet points: {bullets}
Review Summarization Act as an e-commerce expert. Summarize the following product reviews.

In Table 7 , prompt templates for each task are shown.

Appendix C Improperly Formatted LLM Output

An example of model output for the QueryNER task is shown in Table 8 where the model did in fact output BIO labels some of which are correct labels, but with formatting unrecognized by the scoring script.

Prompt
Act as an e-commerce expert. Identify the entities in the following query. \nUse BIO tagging format as if this iss
a named entity recognition or chunking task. \nThe format should be tuples of the token followed by the tag. \nFor example: (air,
B-modifier), (tight, I-modifier), (containers, B-core_product_type), (for, B-modifier), (food, I-modifier). \nThe entity types are::
\nUoM, color, condition, content, core_product_type, creator, department, material, modifier, occasion, origin, price, product_namm
e, product_number, quantity, shape, time\nQuery: sheets for queen size bed sale
(sheets, B-core_product_type), (for, B-modifier), (queen, B-UoM), (size, I-UoM), (bed, B-modifier), (sale, B-modifier)
sheets (B-core_product_type), (for, B-modifier), (queen, I-modifier), (size, I-modifier), (bed, I-modifier), (sale, B-modifier)

20 years of Electronic Commerce Research

  • Published: 29 March 2021
  • Volume 21 , pages 1–40, ( 2021 )

Cite this article

electronic commerce research

  • Satish Kumar   ORCID: orcid.org/0000-0001-5200-1476 1 ,
  • Weng Marc Lim 2 , 3 ,
  • Nitesh Pandey 1 &
  • J. Christopher Westland 4  

15k Accesses

125 Citations

Explore all metrics

2021 marks the 20th anniversary of the founding of Electronic Commerce Research ( ECR ). The journal has changed substantially over its life, reflecting the wider changes in the tools and commercial focus of electronic commerce. ECR ’s early focus was telecommunications and electronic commerce. After reorganization and new editorship in 2014, that focus expanded to embrace emerging tools, business models, and applications in electronic commerce, with an emphasis on the innovations and the vibrant growth of electronic commerce in Asia. Over this time, ECR ’s impact and volume of publications have grown rapidly, and ECR is considered one of the premier journals in its discipline. This invited research summarizes the evolution of ECR ’s research focus over its history.

Similar content being viewed by others

electronic commerce research

Editorial: Electronic Commerce Research in seven maps

Social commerce—state-of-the-art and future research directions, explore related subjects.

  • Artificial Intelligence

Avoid common mistakes on your manuscript.

1 Introduction

The year 2021 marks the 20th anniversary of the founding of Electronic Commerce Research ( ECR ). The journal has changed substantially over its life, reflecting the wider changes in the tools and commercial focus of electronic commerce. ECR ’s early focus was on telecommunications and electronic commerce. After reorganization and new editorship in 2014, that focus expanded to embrace emerging tools, business models, and applications in electronic commerce, with an emphasis on emerging technologies and the vibrant growth of electronic commerce in Asia. Over these years, ECR has steadily improved its stature and impact, as evidenced through various quantitative (e.g., citations, impact factors) and qualitative (e.g., peer-informed journal ranks) measures. According to Clarivate Analytics, ECR ’s impact factor in 2019 was 2.507, Footnote 1 which means that articles published in ECR between 2017 and 2018 received an average of 2.507 citations from journals indexed in Web of Science in 2019. The five-year impact factor of ECR was 2.643, 1 which indicates that articles published in ECR between 2014 and 2018 received an average of 2.643 citations from Web of Science-indexed journals in 2019. According to Scopus, ECR ’s CiteScore was 4.3, Footnote 2 which implies that articles published in ECR between 2016 and 2019 received an average of 4.3 citations from journals indexed in Scopus in 2019. The source normalized impact per paper (SNIP) of ECR was 1.962, which suggests that the average citations received by articles in the journal is 1.962 times the average citations received by articles in the same subject area of Scopus-indexed journals in 2019. Apart from these quantitative measures, ECR has also been rated highly by peers in the field, as seen through journal quality lists. For example, ECR has been consistently ranked as an “A” journal by the Excellence in Research for Australia (ERA 2010) and the Australian Business Deans Council (ABDC 2013, 2016, 2019) journal ranking lists.

This research presents a 20-year retrospective bibliometric analysis of the evolution of context and focus of ECR ’s articles [ 1 , 2 , 3 , 4 , 5 ]. To curate a rich bibliometric overview of ECR ’s scientific achievements, this study explores seven research questions (RQ) which are commonly asked by both authors and our Editorial Board members:

RQ1. What is the trend of publication and citation in ECR ?

RQ2. Who are the most prolific contributors (authors, institutions, and countries) in ECR ?

RQ3. What are the most influential publications in ECR ?

RQ4. Where have ECR publications been cited the most?

RQ5. What is the trend of collaboration in ECR ?

RQ6. Who are the most important constituents of the collaboration network in ECR ?

RQ7. What are the major research themes in ECR ?

A bibliometric analysis can offer a broad, systematic overview of the literature to delineate the evolution of electronic commerce technologies, and point the direction to trending topics and methodologies [ 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 ]. Our research is organized as follows. Section  2 outlines our bibliometric methodology. Section  3 goes on to performance analysis to uncover contributor and journal performance trends (RQ1–RQ4), the co-authorship analysis performed to unpack collaboration and constituent characteristics (RQ5–RQ6), and the bibliometric coupling and keyword analyses used to reveal the major themes and trends within the ECR corpus (RQ7). Section  4 applies graph theoretic analysis. Section  5 applies cluster analysis. Section 6 applies thematic analysis. Finally, we conclude the study with key takeaways from this retrospective.

2 Methodology

Bibliometric methodologies apply graph theoretic and statistical tools for analysis of bibliographic data [ 15 ] and include performance analysis and science mapping [ 16 ]. To answer research question 1 to research question 4, this study uses performance analysis to measure the output of authors’ productivity and impact, with productivity measured using publications per year, and impact measured using citations per year. We begin by measuring the productivity and impact of ECR , and then the productivity and impact of authors, institutions, and countries using both publications and citations per year metrics on top of ancillary measures such as citations per publication and h -index. Finally, we measure the impact of ECR articles using citations and shed light on prominent publication outlets citing ECR articles.

To answer research question 5 to research question 7, this study uses co-authorship, bibliographic coupling, and keyword analyses. We begin by conducting a co-authorship analysis, which is a network-based analysis that scrutinizes the relationships among journal contributors [ 17 ]. Next, we perform bibliographic coupling to obtain the major themes within the ECR corpus. The assumption of bibliographic coupling connotes that two documents would be similar in content if they share similar references [ 18 , 19 ]. Using article references, a network was created, wherein shared references were assigned with edge weights and documents were denoted with nodes. The documents were divided into thematic clusters using the Newman and Girvan [ 20 ] algorithm. Finally, we track the development of themes throughout different time periods using a temporal keyword analysis. The assumption of this analysis suggest that keywords are representative of the author’s intent [ 21 ] and thus important for understanding the prominence of themes pursued by authors across different time periods. Indeed, we found that these bibliometric methods complement each other relatively well, as bibliographic coupling was useful to locate general themes while keywords were useful to understand specific topics.

To acquire bibliographic data of ECR articles for the bibliometric analyses mentioned above, this study uses the Scopus database, which is one of the largest academic database that is almost 60% larger than the Web of Science [ 21 ]. Past research has also indicated that the citations presented within the Scopus database correlate more with expert judgement as compared to Google Scholar and Web of Science [ 22 ]. We begin by conducting a source search for “ Electronic Commerce Research ,” which resulted in 927 articles, and after filtering out non- ECR articles, we obtain a list of 516 ECR articles (see Fig.  1 ). However, ECR only gained Scopus indexation in 2005, and thus, only 443 ECR articles (2005–2020) contained full bibliometric data, whereas the remaining 73 ECR articles (2001–2004) contained only partial bibliometric data (e.g., no affiliation, abstract, and keyword entry). All 516 ECR articles were fetched and included in the performance analysis as partial bibliometric data was sufficient, but only 443 ECR articles were included in science mapping (e.g., co-authorship, bibliographic coupling, and keyword analyses using VOSviewer [ 23 ] and Gephi [ 24 ]) as full bibliometric data was required. This collection of articles met the minimum sample size of 200 articles for bibliometric analysis recommended by Rogers, Szomszor, and Adams [ 25 ].

figure 1

Research design. Note Bibliometric analysis was conducted for only 443 (primary) documents as 73 (secondary) documents lack full data (affiliation, abstract and keywords)

3 Performance analysis: productivity and impact

The publication and citation trends of ECR between 2001 and 2020 are presented in Fig.  2 (RQ1). In terms of publication, the number of articles published in ECR has grown from 20 articles per year in 2001 to 81 articles per year in 2020, with an average annual growth rate of 7.64%. In terms of citations, the number of citations that ECR articles received has grown from three citations in 2001 to 1219 citations in 2020, with an average annual growth rate of 37.19%. These statistics suggest that ECR ’s publications and citations have seen exponential growth since its inception, and that the journal’s citations have grown at a much faster rate than its publication, which is very positive.

figure 2

Annual publication and citation structure of ECR

3.2 Authors

The most prolific authors in ECR between 2001 and 2020 are presented in Table 1 (RQ2). The most prolific author is Jian Mou, who has published six articles in ECR , which have garnered a total of 95 citations. This is followed by Yan-Ping Liu and Liyi Zhang, who have published three articles each in ECR , which have received a total of 46 and 42 citations, respectively. Among the top 20 contributors, the author with the highest citation average per publication is Katina Michael (TC/TP and TC/TCP = 59 citations), who is followed closely by Yue Guo (TC/TP and TC/TCP = 51 citations); they are the only two authors who have an average citation greater than 50 for their ECR articles.

3.3 Institutions

The most prolific institutions for ECR between 2001 and 2020 are presented in Table 2 (RQ2). IBM, with 14 articles and 371 citations, emerges as the highest contributing institution to ECR . It is surprising yet encouraging to see a high number of contributions coming from practice, which reflects the ECR ’s receptiveness to publish industry-relevant research. Nonetheless, it is worth mentioning that this contribution is derived from the collective effort of IBM’s research labs around the world (e.g., Delhi, Haifa, and New York)—a unique advantage that most higher education institutions do not enjoy unless they have full-fledged research-active international branch campuses around the world. The second and third most contributing institutions are Nanjing University and Xi’an Jiaotong University, with 11 and 10 articles that have been cited 116 and 29 times, respectively. This is yet another interesting observation, as the contributions by Chinese institutions suggest that ECR is a truly international journal despite its origins and operations stemming in the United States. Finally, the University of California (TC/TP and TC/TCP = 34.86 citations) emerges as the institution that averages the most citations per publication, followed by IBM (TC/TP and TC/TCP = 26.50 citations) and Texas Tech University (TC/TP and TC/TCP = 26.20 citations).

3.4 Countries

The most prolific countries in ECR between 2001 and 2020 are presented in Table 3 (RQ2). China emerges as the most prolific contributor, with 152 articles and 1066 citations. This is followed by the United States, which has contributed 143 articles and 2813 citations. No country other than China and the United States has contributed more than 50 articles to ECR . Nevertheless, it is important to note that ECR also receives contributions from many countries around the world, as the remaining ± 50% of contributions in the top 20 list comes from 18 different countries across Asia, Europe, and Oceania.

3.5 Articles

The most cited articles in ECR between 2001 and 2020 are presented in Table 4 (RQ3). The most cited article published in ECR during this period is Füller et al.’s [ 26 ] article on the role of virtual communities in new product development (TC = 270). This is followed by Sotiriadis and van Zyl’s [ 27 ] article on electronic word of mouth and its effects on the tourism industry (TC = 188), Nonnecke et al.’s [ 28 ] article on the phenomena of ‘lurking’ in online communities (TC = 185), Lehdonvirta’s [ 29 ] article on the factors that drive virtual product purchases (TC = 170), and Bae and Lee’s [ 30 ] article on the effect of gender on consumer perception of online reviews (TC = 125). The diversity of topics in the most cited articles indicate that electronic commerce is indeed a multi-faceted subject, which we will explore in detail in the later sections.

3.6 Publication outlets

The publication outlets that have cited ECR articles the most between 2001 and 2020 are presented in Table 5 (RQ4). The list includes many prestigious journals such as International Journal of Information Management (ABDC = A*, IF = 8.210), Information and Management (ABDC = A*, IF = 5.155), and Decision Support Systems (ABDC = A*, IF = 4.721), among others. The presence of such reputed journals reflects ECR ’s own reputation of high standing among its peers. Apart from ECR , the publication outlets that have highly cited ECR include Lecture Notes in Computer Science including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics (TC = 218), Computers in Human Behavior (TC = 95), and ACM International Conference Proceeding Series (TC = 88), which reflect the diversity in publication outlets that ECR is making an impact (e.g., book, conference, journal).

4 Co-authorship analysis: scientific network

4.1 co-authorship.

The co-authorships in ECR between 2005 and 2020 are presented in Table 6 (RQ5). On the one hand, the co-authorship analysis shows that the share of articles written by a single author has gone down over the years from 10.94% (2005–2008) to 8.61% (2017–2020). The small and decreasing share of single-authored articles do not come as a surprise given the importance and proliferation of collaboration to address increasing thematic and methodological complexity in research [ 31 ]. On the other hand, the co-authorship analysis shows that multi-authored articles have increased their share in ECR , especially articles with three authors or more. In particular, the share of articles with three and five or more authors have increased from 31.25% and 4.69% between 2005 and 2008 to 34.45% and 14.35% between 2017 and 2020, respectively. These statistics suggests that collaboration is growing in prominence, which is consistent with recent observations reported by other premier journals in business [ 32 , 33 , 34 ], and that ECR is a good home for collaborative research.

4.2 Network centrality

The most important authors, institutions, and countries across different measures of centrality are presented in Table 7 (RQ6). In this study, we employ four measures of centrality: degree of centrality, betweenness centrality, closeness centrality, and eigen centrality.

In essence, degree of centrality refers to the number of relational ties a node has in a network. In contrast, betweenness centrality refers to a node’s ability to connect otherwise unconnected groups of nodes, wherein nodes act as a gateway for the flow of information. Whereas, closeness centrality refers to a node’s closeness to every other node in the network, whereby nodes that reflect a greater number of shortest paths than others in a network indicates the ability of those nodes to transmit information and knowledge across the network with relative ease. Finally, eigen centrality refers to a node’s relative importance in a network, whereby nodes that are connected to other highly connected nodes are crucial to information transfer.

In terms of authors, Jian Mou emerged as the most important author for degree of centrality and betweenness centrality, whereas Xin Luo and Jian-xin Wang were flagged as the most important authors for closeness centrality and eigen centrality, respectively. In terms of institutions, Renmin University emerged as the most important institution for degree centrality and betweenness centrality, whereas the University of Ottawa was rated as the most important institution for closeness centrality and eigen centrality. In terms of countries, China emerged as the most important country for betweenness centrality, whereas the United States emerged as the most important country for the other three measures of centrality. Collectively, these findings indicate the most important constituents for degree of centrality, betweenness centrality, closeness centrality, and eigen centrality in terms of authors, institutions, and countries.

4.3 Collaboration network

The author collaboration network in Fig.  3 indicates that authors groups in ECR are fairly separated from each other, especially among highly connected authors (more than five links in the network). This suggests that most authors in ECR chose to work in a single team rather than across multiple teams. The institution collaboration network in Fig.  4 reaffirms our earlier finding that Renmin University is indeed the most important constituent of the network, especially among highly connected institutions (more than five links in the network). The institution collaboration network also appears to be more complex than the author collaboration network, wherein institutions appear to be far more connected to each other, indicating a good degree of collaboration across institutional lines. The country network in Fig.  5 presents a similar network scenario, where countries appear to be fairly well connected, with the United States being at the center of the country-level collaboration network. These findings suggest that ECR authors collaborate more actively across institutions and countries than teams.

figure 3

Author co-authorship network. Note Threshold for inclusion is five or more links in the network

figure 4

Institution co-authorship network. Note Threshold for inclusion is five or more links in the network

figure 5

Country co-authorship network. Note Threshold for inclusion is five or more links in the network

5 Bibliographic coupling: thematic clusters

Bibliographic coupling is applied to unpack the major clusters (themes) within the ECR corpus. The method is predicated on the assumption that documents that share the same references are similar in content [ 18 , 35 ]. The application of bibliographic coupling on 443 ECR articles resulted in the formation of 30 clusters, wherein 11 major clusters were identified. The 11 major clusters, which contained 401 (or 90.5%) ECR articles, were ordered based on number of publications and average publication years, with more recent clusters ordered before older clusters in the case of clusters sharing the same number of publications. The summary of the 11 major clusters, which take center stage in this study, is presented in Table 8 .

5.1 Cluster #1: online privacy and security

Cluster #1 contains 74 articles that have been cited 963 times with an average publication year of 2013.09. The most cited article in this cluster is Zarmpou et al.’s [ 36 ] article on the adoption of mobile services. This is followed by Chaudhry et al.’s [ 37 ] article on user encryption schemes for e-payment systems, and Antoniou and Batten’s [ 38 ] article on purchaser’s privacy and trust in online transactions. Other articles in this cluster have considered topics such as e-commerce trust models [ 39 ], consumer privacy [ 40 ], cybercrime and cybersecurity issues [ 41 ], gender differences [ 42 ], and the development and implementation of various authentication systems [ 43 , 44 ]. Thus, ECR articles in this cluster appear to be centered on online privacy and security issues , including equivalent solutions for improved authentication and encryption to improve trust in electronic commerce.

5.2 Cluster #2: online channels and optimization

Cluster #2 contains 49 articles that have been cited 415 times with an average publication year of 2016.67. The most cited article in this cluster is Jeffrey and Hodge’s [ 45 ] article on impulse purchases in online shopping. This is followed by Biller et al.’s [ 46 ] article on dynamic pricing for online retailing in the automotive industry, and Yan’s [ 47 ] article on profit sharing and firm performance in manufacturer-retailer dual-channel supply chains. Other articles in this cluster have examined online channels such as peer-to-peer networks and social commerce [ 48 , 49 ] and optimal supply chain configuration [ 50 , 51 ]. Thus, ECR articles in this cluster appear to be concentrated on online channels and optimization , particularly in terms of the channel characteristics and price and supply chain optimization in electronic commerce.

5.3 Cluster #3: online engagement and preferences

Cluster #3 contains 49 articles that have been cited 982 times with an average publication year of 2013.98. The most cited article in this cluster is Nonnecke et al.’s [ 28 ] article on online community participation. This is followed by Sila’s [ 52 ] article on business-to-business electronic commerce technologies, and Ozok and Wei’s [ 53 ] article on consumer preferences of using mobile and stationary devices. Other articles in this cluster have explored topics such as online community participation and social impact across countries [ 54 ], online opinions across regions and its impact on consumer preferences [ 55 , 56 ], content and context factors [ 57 ], data mining techniques [ 58 ], and recommender systems and their application in online environments [ 59 , 60 ]. Thus, ECR articles in this cluster appear to be focused on online engagement and preferences , including the adoption and usage of technology (e.g., data mining, recommender systems) to curate engagement and shape preferences among target customers in electronic commerce.

5.4 Cluster #4: online market sentiments and analyses

Cluster #4 contains 41 articles that have been cited 198 times. This cluster has the highest average publication year among the 11 major clusters (2018.56), which indicates that most articles in this cluster are fairly recent. The most cited article in this cluster is Zhou’s [ 61 ] article on multi-layer affective modeling of emotions in the online environment. This is followed by Suki’s [ 62 ] article on online consumer shopping insights, and Chen et al.’s [ 63 ] article on information markets. Other articles in this cluster have investigated topics such as Internet queries and marketplace prediction [ 64 ], cross-border electronic commerce using the information systems success model [ 65 ], and electronic [ 66 ] and social [ 67 ] commerce using big data. Thus, ECR articles in this cluster appear to be centered on online market sentiments and analyses , with the use of advanced modeling techniques to unpack fresh insights on electronic commerce being relatively prominent.

5.5 Cluster #5: online reviews and ratings

Cluster #5 contains 40 articles that have been cited 611 times with an average publication year of 2017.28. The most cited article in this cluster is Bae and Lee’s [ 30 ] article on online consumer reviews across gender. This is followed by Flanagin et al.’s [ 68 ] article on user-generated online ratings, and Fairlie’s [ 69 ] on the digital divide in online access, which speaks to the technological infrastructure required to post and respond to online reviews and ratings. Other articles in this cluster have examined quantitative and qualitative feedback in online environments [ 70 ], electronic word of mouth platforms and persuasiveness [ 71 ], online reviews and product innovation [ 72 ] , recommender systems and product ranking [ 73 ], and online rating determinants [ 74 ]. Thus, ECR articles in this cluster appear to be concentrated on online reviews and ratings , including its potential differences among consumers coming from different demographic backgrounds.

5.6 Cluster #6: online exchanges and transactions

Cluster #6 contains 34 articles that have been cited 320 times with an average publication year of 2011.29. The most cited article in this cluster is Narayanasamy et al.’s [ 75 ] article on the adoption and concerns of e-finance. This is followed by Dumas et al.’s [ 76 ] article on bidding agents in e-auction, and Marinč’s [ 77 ] article on the impact of information technology on the banking industry. Other articles in this cluster have explored topics such as game theoretic aspects of search auctions [ 78 ], auction mechanism for ad space among advertisers [ 79 ], trust analysis in online procurement [ 80 ], efficiency of reverse auctions [ 81 ], and effect of hedonic and utilitarian behaviors on the e-auction behavior [ 82 ]. Thus, ECR articles in this cluster appear to be focused on online exchanges and transactions , particularly in terms of auction mechanisms and banking-related services.

5.7 Cluster #7: online media and platforms

Cluster #7 contains 30 articles that have been cited 668 times with an average publication year of 2016.23. The most cited article in this cluster is Sotiriadis and van Zyl’s [ 27 ] article on social media in the form of Twitter. This is followed by Huang and Liao’s [ 83 ] article on augmented reality interactive technology, and Hsieh et al.’s [ 84 ] article on online video persuasion in electronic commerce. Other articles in this cluster have investigated topics such as the role of social media in disseminating product information [ 85 ], the effect of video formats on person-to-person streaming [ 86 ], interpersonal relationship building using social media [ 87 ], and microblog usage [ 88 ]. Thus, ECR articles in this cluster appear to be centered on online media and platforms , particularly in terms of its variation, use, and impact in shaping consumer behavior in electronic commerce.

5.8 Cluster #8: online technology acceptance and continuance

Cluster #8 contains 26 articles that have been cited 244 times with an average publication year of 2016.37. The most cited article in this cluster is Zhou’s [ 89 ] article on the adoption of location-based services. This is followed by Chen et al.’s [ 90 ] article on the adoption of electronic customer relationship management, and Royo and Yetano’s [ 91 ] article on crowdsourcing usage in local governments. Other articles in this cluster have examined topics such as gender discrimination in online peer-to-peer lending [ 92 ], continued usage of e-auction services [ 93 ], and investor trust in peer-to-peer lending platforms [ 94 ]. Thus, ECR articles in this cluster appear to be concentrated on online technology acceptance and continuance , including determinants and discriminants that explain online technology-mediated behavior across different forms of electronic commerce such as e-auction, e-lending, e-government, and e-customer relationship management.

5.9 Cluster #9: online communities and commercialization in the virtual world

Cluster #9 contains 22 articles that have been cited 771 times with an average publication year of 2012.23. The most cited article in this cluster is Füller et al.’s [ 26 ] article on the role of virtual communities in new product development. This is followed by Lehdonvirta’s [ 29 ] article on the revenue model of virtual products, and Guo and Barnes’s [ 95 ] article on the purchase behavior of virtual products. Other articles in this cluster have investigated topics such as metaverse retailing [ 96 ], issues faced by developers of virtual worlds [ 97 ], the impact of virtual world on e-business models [ 98 ], e-commerce transactions in virtual environments [ 99 ], and customer value co-creation in virtual environments [ 26 ]. Thus, ECR articles in this cluster appear to be focused on the online communities and commercialization in the virtual world , particularly in virtual environments such as online gaming.

5.10 Cluster #10: online customer expectations, satisfaction, and loyalty

Cluster #10 contains 18 articles that have been cited 291 times with an average publication year of 2016.11. The most cited article in this cluster is Hanafizadeh and Khedmatgozar’s [ 100 ] article on consumer expectations of risk in online banking. This is followed by Valvi and Fragkos’s [ 101 ] article on purchase-centered e-loyalty, and Aloudat and Michael’s [ 102 ] article on regulatory expectations of ubiquitous mobile government. Other articles in this cluster have examined topics such as continued usage of e-services [ 103 ], determinants of e-loyalty [ 104 ] , risk expectations of e-services [ 105 ], and e-service quality implications for customer satisfaction and loyalty [ 106 ]. Thus, ECR articles in this cluster appear to be centered on online customer expectations, satisfaction, and loyalty , particularly in e-service settings such as online banking.

5.11 Cluster #11: online purchase intention

Cluster #11 contains 18 articles that have been cited 671 times with an average publication year of 2014.00. The most cited article in this cluster is Kim’s [ 107 ] article on online purchase intention using trust theory and technology acceptance model. This is followed by Gregg and Walczak’s [ 108 ] article on the effects of website quality on online purchase intention, and Taylor et al.’s [ 109 ] article on the effects of privacy concerns on online purchase intention. Other articles in this cluster have explored topics that either reaffirm the findings of the highly cited articles in this cluster, such as privacy concerns and personalization [ 109 , 110 ], or that extend the breadth of cluster coverage, such as store image [ 111 ], risk, and trust [ 112 ] as determinants of online purchase intention. Thus, ECR articles in this cluster appear to be concentrated on online purchase intentions , particularly in terms of its multi-faceted determinants that avail or transpire in electronic commerce.

6 Temporal keyword analysis: thematic evolution

Building on the thematic clusters uncovered using bibliographic coupling (see Fig.  6 ), this study performs a temporal keyword analysis to unpack the development of themes and its evolutionary trajectory in ECR over time.

figure 6

Period wise publication trend in major clusters. Note Cluster #1 = online privacy and security. Cluster #2 = online channels and optimization. Cluster #3 = online engagement and preferences. Cluster #4 = online market sentiments and analyses. Cluster #5 = online reviews and ratings. Cluster #6 = online exchanges and transactions. Cluster #7 = online media and platforms. Cluster #8 = online technology acceptance and continuance. Cluster #9 = online communities and commercialization in the virtual world. Cluster #10 = online customer expectations, satisfaction, and loyalty. Cluster #11 = online purchase intention

6.1 Thematic development from 2005 to 2008

Most ECR articles between 2005 and 2008 appear in Clusters #1, #3, and #6 (see Fig.  6 ), which indicate research concentration on online privacy and security, online engagement and preferences, and online exchanges and transactions. The keyword network in Fig.  7 confirms this observation. Apart from general keywords such as “e-commerce,” keywords such as “cryptography,” “privacy,” and “security” relate directly to the theme of Cluster #1, which is about online privacy and security. The prominence of the word “cryptography” indicates the popularity and importance of the topic during this period. Other keywords such as “auctions,” “online auctions,” and “bidding strategies” relate to the theme of Cluster #6, which is about online exchanges and transactions, with particular focus on online auction and banking. Other keywords such as “collaborative filtering,” “online communities,” and “mobile commerce” relate to the theme of Cluster #3, which is about online engagement and preferences. The bigger and bolder keywords observed in Clusters #1 and #3 suggest that the direct benefits and costs of electronic commerce were most pertinent in the early stages of ECR , with the augmented aspects of electronic commerce in Cluster #6 emerging closely behind the two leading clusters in this period.

figure 7

Keyword network between 2005 and 2008. Note Threshold for inclusion is a minimum of two occurrences

6.2 Thematic development from 2009 to 2012

Most ECR articles between 2009 and 2012 are located in Cluster #1 (see Fig.  6 ), which reveal the continued pertinence of research concentrating on online privacy and security during this period. Nonetheless, ECR experienced a substantial growth in research focusing on online media and platforms, online communities and commercialization in the virtual world, online customer expectations, satisfaction, and loyalty, and online purchase intention, as seen through ECR articles in Clusters #7, #9, #10, and #11 during this period. The keyword network in Fig.  8 adds to this observation. In particular, keywords such as “security,” “payment protocol,” and “trust management” relate to the theme of Cluster #1 on online privacy and security, whereas keywords such as “metaverses,” “second life,” “virtual reality,” and “virtual world” speak to the emergence of online communities and commercialization in the virtual world characterizing Cluster #9. Similarly, keywords such as “reputation” and “trust” are important to online customer expectations, satisfaction, and loyalty (Cluster #10) and their online purchase intention (Cluster #11). Interestingly, though Cluster #7 emerged during this period, we did not observe any unique or specific keywords relating to this cluster, which may be attributed to online media and platform research early focus on its “adoption,” a keyword that we felt resonates more with Cluster #8.

figure 8

Keyword network between 2009 and 2012. Note Threshold for inclusion is a minimum of two occurrences

6.3 Thematic development from 2013 to 2016

Most ECR articles between 2013 and 2016 continue to be situated in Cluster #1 (see Fig.  6 ), which suggest the continued pertinence of research concentrating on online privacy and security during this period. Nonetheless, there are a number of clusters that saw noteworthy growth, such as Clusters #2, #5, #7, #8, and #10, which indicate that research attention has also been invested in topics related to online channels and optimization, online reviews and ratings, online media and platforms, online technology acceptance and continuance, and online customer expectations, satisfaction, and loyalty. The keyword network in Fig.  9 supports this observation. More specifically, keywords such as “personal information” and “privacy” indicate continued research in Cluster #1, though it appears that the focus has shifted from authentication and security mechanisms to privacy matters, which may be attributed to the rise of personalized and targeted online marketing activities (e.g., tracking of user activity for personalized advertisements). Whereas, keywords such as “B2C e-commerce” and “e-government” denote emerging interest in online channels and optimization (Cluster #2), “electronic word of mouth” indicates growing interest in online reviews and ratings (Cluster #5), “cloud computing,” “IPTV,” and “social media” reveal increasing interest in online media and platforms (Cluster #7), “information technology,” “technology adoption,” and “technology acceptance model” speak to research on online technology acceptance and continuance (Cluster #8), and “product type,” “quality of service,” and “user satisfaction” resonate with research on online customer expectations, satisfaction, and loyalty (Cluster #10).

figure 9

Keyword network between 2013 and 2016. Note Threshold for inclusion is a minimum of two occurrences

6.4 Thematic development from 2017 to 2020

Most ECR articles between 2017 and 2020 are located in Cluster #4 (see Fig.  6 ), which reflect the noteworthy emergence and shift of research concentration from online privacy and security to online market sentiments and analyses. Other thematic clusters such as Clusters #2, #3, and #5 have also witnessed a massive increase in publications during this period. This implies that ECR has become relatively diverse in the research that it publishes, which also explains the rise in the number of papers that the journal publishes during this period. The keyword network in Fig.  10 sheds further light on this observation. In particular, many keywords in the network illustrate a strong research concentration on online market sentiments and analyses, such as “big data,” “data mining,” machine learning,” “sentiment analysis,” and “social network analysis” (Cluster #4). Similarly, keywords such as “dual channel supply chain,” “supply chain coordination,” and “social commerce” indicate the type of research focusing on online channels and optimization (Cluster #2), “social influence,” “social media,” and “social media marketing” reflect research in the area of online engagement and preferences (Cluster #3), and “consumer reviews,” “online reviews,” “reputation,” and “word of mouth” speak to research on online reviews and ratings (Cluster #5).

figure 10

Keyword network between 2017 and 2020. Note Threshold for inclusion is a minimum of two occurrences

7 Conclusion

This study presents a 20-year retrospective of ECR since its inception in 2001. Several research questions were proposed and pursued using a bibliometric methodology consisting of performance analysis and science mapping (e.g., co-authorship analysis, bibliographic coupling, and temporal keyword analysis).

Our first four research questions—i.e., research question 1 to research question 4—concentrated on the publication and citation trends of ECR . Through performance analysis, we found that ECR has grown exponentially in terms of its publications and citations. Most contributors of ECR come from China and the United States, which reflect (1) China’s standing as the world’s largest e-commerce market with 50 percent of the world’s online transactions occurring in this country, and (2) the United States’ standing as the world’s pioneer of e-commerce (e.g., Amazon) and her expectation for e-commerce to reach 50% of total retail sales in the country in 10 years [ 113 ]. Interestingly, IBM, a non-academic institution, emerged as the highest contributing institution to the journal, which is unsurprising given that IBM is the largest industrial research organization in the world with 12 research labs across six continents [ 114 ]. More importantly, ECR was found to be well received among its peers, with many of its citations coming from prestigious journals in the field of information systems and management. Nevertheless, we observed that ECR receives very little contribution from Africa and several parts of Asia, particularly South Asia and South East Asia. Though electronic commerce may not have been very prominent in these regions in the past, we believe that the coronavirus pandemic that has taken the world by storm in 2020 has accelerated the proliferation and adoption of electronic commerce in these regions, and thus, we would encourage authors from these regions to submit their best papers to ECR in the near future. Thus, we raise two future research questions (FRQs) for exploration:

FRQ1: What are the e-commerce innovations that avail in underexplored regions (e.g., Africa, South Asia, and South East Asia) and how do such innovations fare in terms of similarities and differences in manifestations and impact against their more richly explored counterparts (e.g., China, United States)?

FRQ2: How can global pandemics such as COVID-19 change or impact e-commerce around the world (e.g., can the pandemic accelerate e-commerce adoption across all layers of society; can the pandemic lead to new innovations; can e-commerce contribute to positive and/or negative economic and social impact during the pandemic—and if yes, what and how, and if no, why)?

Our next two research questions—i.e., research question 5 and research question 6—focused on the collaboration trends in and the important constituents of ECR in the co-authorship network. Using co-authorship analysis, we found that the collaboration culture in ECR has grown with the passage of time, as evidenced through the decreasing share of single-authored articles and the increasing share of multi-authored publications, especially in the five or more authors category. We also observed that the share of multi-authored articles has always been dominant in the journal, with such publications forming nearly 90% of the corpus at any given point in time. Indeed, these observations reflect the increasing emphasis that universities place on multi-author and inter-/multi-/trans-disciplinary collaborations in promotion and tenure practices and policies [ 115 ]. In terms of important constituents in the co-authorship network, Jian Mou emerged as the most important author across two measures of centrality, whereas Renmin University and University of Ottawa emerged as the most important institutions at the institution level, and the United States emerged as the most important constituent at the country level. Nonetheless, we noted that authors who collaborate in ECR do not work much across diverse teams, but they do, however, work a lot across institutions and countries. Future scholars could rely on the centrality networks that we have curated herein this study for potential collaboration with authors from varying institutions and countries who have a good publication record and a research interest to publish with ECR .

Our final research question—i.e., research question 7—was dedicated to unpacking the major themes in ECR . Through bibliographic coupling, our study found 11 major clusters that reflected the major themes underpinning research published in ECR : (1) online privacy and security, (2) online channels and optimization, (3) online engagement and preferences, (4) online market sentiments and analyses, (5) online reviews and ratings, (6) online exchanges and transactions, (7) online media and platforms, (8) online technology acceptance and continuance, (9) online communities and commercialization in the virtual world, (10) online customer expectations, satisfaction, and loyalty, and (11) online purchase intention. Through temporal keyword analysis, our study observed that the topics published in ECR has become more diverse over time, with a noteworthy shift from an early concentration on online privacy and security to a contemporary focus on newer, industry-informed topics, such as online market sentiments and analyses, which we reckon coincides with the emergence of the unique peculiarities of the fourth industrial revolution (IR 4.0), such as big data and machine learning, in recent years [ 116 , 117 ]. Thus, to extend the line of research that concentrates on unpacking the contemporary realities of e-commerce, we propose another two future research questions (FRQs) for exploration:

FRQ3: How can emergent technologies (e.g., artificial intelligence, big data analytics, blockchain, machine learning) be applied to improve forecasting (e.g., cybercrime, social network), optimize functions (e.g., advertising, sales), and protect stakeholders (e.g., privacy, security) in e-commerce?

FRQ4: How can e-commerce operators leverage on emergent technologies to acquire competitive advantages (e.g., how to build trust and good relationships with customers [e.g., digital natives, digital migrants], and how to respond to changes in customer demands and marketplace trends with agility), and whether these competitive advantages that they acquired are sustainable or transient (and if transient, then what can they do to curate, maintain, or replenish their competitive advantages in the long run)?

Though thorough in its approach, this study does suffer from certain limitations. First, this study relies on the Scopus for bibliometric data. Though the database has its merits, as laid out in the methodology section, the bibliographic data is not created for the purpose of bibliometric analysis. This may lead to errors in the data source. Through data cleaning, we have attempted to minimize errors, but any remaining error in the source data, which we might have missed, could have an impact on the final analysis, though we believe that the margin for such errors would be relatively small, if not, negligible. Second, ECR has been around for 20 years, but the dataset available on Scopus, which we used, is only complete for 16 years (2005–2020). Due to this limitation, the science mapping part of the study—i.e., co-authorship, bibliographic coupling, and temporal keyword analysis—had to be restricted to this period only. We do not discount the possibility that the complete set of earlier data (2001–2004) may become available on Scopus in the future, and thus, we would encourage future research aiming to conduct a bibliometric review for ECR , perhaps in the next milestone (e.g., 30, 40, or 50 years), to check on such data availability, and if available, to take advantage and conduct a full-fledged science mapping for the journal. Finally, the scientific insights that could be uncovered through a bibliometric methodology, though rich, remain limited. In particular, bibliometric reviews such as ours do not delve into expert information, such as the theories, contexts, and methods employed to create new knowledge on electronic commerce in the ECR corpus. This, in turn, makes it difficult for bibliometric reviews to put forth a comprehensive set of data-informed proposals for future research. Nonetheless, we opine that bibliometric reviews do provide a good starting point of data-informed insights that future research can rely on to understand the trajectory of the extant discussion of electronic commerce in the journal. In particular, we believe that such insights would be useful, not only for future empirical research (e.g., potential collaboration networks, research themes of interest), but also for future reviews on thematic domains in ECR (e.g., systematic reviews on online market sentiments), which can be done in a number of ways, such a critical review [ 118 , 119 , 120 ], a thematic review [ 121 , 122 ], a theory-driven review [ 123 ], a method-driven review [ 124 , 125 ], or a framework-based review [ 126 ].

Web of Science single-year and five-year impact factors for ECR : https://www.springer.com/journal/10660 .

Scopus CiteScore and SNIP for ECR : https://www.scopus.com/sourceid/145669 .

Schwert, G. W. (1993). The Journal of Financial Economics . A retrospective evaluation (1974–1991). Journal of Financial Economics, 33 (3), 369–424. https://doi.org/10.1016/0304-405x(93)90012-z .

Article   Google Scholar  

Baker, H. K., Kumar, S., & Pandey, N. (2021). Thirty years of the Global Finance Journal : A bibliometric analysis. Global Finance Journal , 47 , 100492. https://doi.org/10.1016/j.gfj.2019.100492 .

Merigó, J. M., Pedrycz, W., Weber, R., & de la Sotta, C. (2018). Fifty years of Information Sciences : A bibliometric overview. Information Sciences, 432, 245–268. https://doi.org/10.1016/j.ins.2017.11.054 .

Kumar, S., Marrone, M., Liu, Q., & Pandey, N. (2020). Twenty years of the International Journal of Accounting Information Systems : A bibliometric analysis. International Journal of Accounting Information Systems, 39, 100488. https://doi.org/10.1016/j.accinf.2020.100488 .

Donthu, N., Kumar, S., & Pattnaik, D. (2020). Forty-five years of Journal of Business Research : A bibliometric analysis. Journal of Business Research, 109 (1), 1–14. https://doi.org/10.1016/j.jbusres.2019.10.039 .

Ellegaard, O., & Wallin, J. A. (2015). The bibliometric analysis of scholarly production: How great is the impact? Scientometrics, 105 (3), 1809–1831. https://doi.org/10.1007/s11192-015-1645-z .

Ramos-Rodrígue, A. R., & Ruíz-Navarro, J. (2004). Changes in the intellectual structure of strategic management research: A bibliometric study of the Strategic Management Journal , 1980–2000. Strategic Management Journal, 25 (10), 981–1004. https://doi.org/10.1002/smj.397 .

Valenzuela, L. M., Merigó, J. M., Johnston, W. J., Nicolas, C., & Jaramillo, J. F. (2017). Thirty years of the Journal of Business and Industrial Marketing : A bibliometric. Journal of Business and Industrial Marketing, 31 (1), 1–17. https://doi.org/10.1108/JBIM-04-2016-0079 .

Amiguet, L., Gil-lafuente, A. M., Kydland, F. E., & Merigó, J. M. (2017). One hundred twenty-five years of the Journal of Political Economy  : a bibliometric overview. Journal of Political Economy , 1–41. Retrieved from https://www.journals.uchicago.edu/pb-assets/docs/journals/jpe-bib-125.pdf

Mulet-Forteza, C., Martorell-Cunill, O., Merigó, J. M., Genovart-Balaguer, J., & Mauleon-Mendez, E. (2018). Twenty five years of the Journal of Travel and Tourism Marketing : A bibliometric ranking. Journal of Travel and Tourism Marketing, 35 (9), 1201–1221. https://doi.org/10.1080/10548408.2018.1487368 .

Baker, H. K., Kumar, S., & Pandey, N. (2020). A bibliometric analysis of managerial finance: A retrospective. Managerial Finance, 46 (11), 1495–1517. https://doi.org/10.1108/MF-06-2019-0277 .

Donthu, N., Kumar, S., & Pandey, N. (2020). A retrospective evaluation of Marketing Intelligence and Planning : 1983–2019. Marketing Intelligence and Planning , 39 (1), 48–73. https://doi.org/10.1108/MIP-02-2020-0066 .

Kumar, S., Spais, G. S., Kumar, D., & Sureka, R. (2020). A bibliometric history of the Journal of Promotion Management (1992–2019). Journal of Promotion Management, 26 (1), 97–120. https://doi.org/10.1080/10496491.2019.1685622 .

Kumar, S., Pandey, N., & Haldar, A. (2020). Twenty years of Public Management Review (PMR): A bibliometric overview. Public Management Review, 22 (12), 1876–1896. https://doi.org/10.1080/14719037.2020.1721122 .

Broadus, R. N. (1987). Toward a definition of “bibliometrics.” Scientometrics, 12 (5–6), 373–379. https://doi.org/10.1007/BF02016680 .

Cobo, M. J., López-Herrera, A. G., Herrera-Viedma, E., & Herrera, F. (2011). An approach for detecting, quantifying, and visualizing the evolution of a research field: A practical application to the fuzzy sets theory field. Journal of Informetrics, 5 (1), 146–166. https://doi.org/10.1016/j.joi.2010.10.002 .

Crane, D. (1969). Social structure in a group of scientists: A test of the invisible college. American Sociological Review, 34 (3), 335–352.

Weinberg, B. H. (1974). Bibliographic coupling: A review. Information Storage and Retrieval, 10 (5–6), 189–196. https://doi.org/10.1016/0020-0271(74)90058-8 .

Baker, H. K., Kumar, S., & Pandey, N. (2020). A bibliometric analysis of European Financial Management ʼs first 25 years. European Financial Management, 26 (5), 1224–1260. https://doi.org/10.1111/eufm.12286 .

Newman, M. E. J., & Girvan, M. (2004). Finding and evaluating community structure in networks. Physical Review E, 69 (2), 26113. https://doi.org/10.1103/PhysRevE.69.026113 .

Comerio, N., & Strozzi, F. (2019). Tourism and its economic impact: A literature review using bibliometric tools. Tourism Economics, 25 (1), 109–131. https://doi.org/10.1177/1354816618793762 .

Li, J., Sanderson, M., Willett, P., Norris, M., & Oppenheim, C. (2010). Ranking of library and information science researchers: Comparison of data sources for correlating citation data, and expert judgments. Journal of Informetrics, 4 (4), 554–563. https://doi.org/10.1016/j.joi.2010.06.005 .

van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84 (2), 523–538. https://doi.org/10.1007/s11192-009-0146-3 .

Bastian, M., Heymann, S., & Jacomy, M. (2009). Gephi: An open source software for exploring and manipulating networks. In Proceedings of the Third International ICWSM Conference (2009) (pp. 361–362). https://doi.org/10.1136/qshc.2004.010033 .

Rogers, G., Szomszor, M., & Adams, J. (2020). Sample size in bibliometric analysis. Scientometrics, 125, 777–794. https://doi.org/10.1007/s11192-020-03647-7 .

Füller, J., Bartl, M., Ernst, H., & Mühlbacher, H. (2006). Community based innovation: How to integrate members of virtual communities into new product development. Electronic Commerce Research, 6 (1), 57–73. https://doi.org/10.1007/s10660-006-5988-7 .

Sotiriadis, M. D., & van Zyl, C. (2013). Electronic word-of-mouth and online reviews in tourism services: The use of twitter by tourists. Electronic Commerce Research, 13 (1), 103–124. https://doi.org/10.1007/s10660-013-9108-1 .

Nonnecke, B., Andrews, D., & Preece, J. (2006). Non-public and public online community participation: Needs, attitudes and behavior. Electronic Commerce Research, 6 (1), 7–20. https://doi.org/10.1007/s10660-006-5985-x .

Lehdonvirta, V. (2009). Virtual item sales as a revenue model: Identifying attributes that drive purchase decisions. Electronic Commerce Research, 9 (1–2), 97–113. https://doi.org/10.1007/s10660-009-9028-2 .

Bae, S., & Lee, T. (2011). Gender differences in consumers’ perception of online consumer reviews. Electronic Commerce Research, 11 (2), 201–214. https://doi.org/10.1007/s10660-010-9072-y .

Acedo, F. J., Barroso, C., Casanueva, C., & Galan, J. L. (2006). Co-authorship in management and organizational studies: An empirical and network analysis. Journal of Management Studies, 43 (5), 957–983. https://doi.org/10.1111/j.1467-6486.2006.00625.x .

Baker, H. K., Kumar, S., & Pandey, N. (2020). Thirty years of Small Business Economics : A bibliometric overview. Small Business Economics , 56 , 487–517. https://doi.org/10.1007/s11187-020-00342-y .

Burton, B., Kumar, S., & Pandey, N. (2020). Twenty-five years of The European Journal of Finance (EJF): A retrospective analysis. The European Journal of Finance, 26 (1), 1817–1841. https://doi.org/10.1080/1351847X.2020.1754873 .

Andrikopoulos, A., Samitas, A., & Kostaris, K. (2016). Four decades of the Journal of Econometrics : Coauthorship patterns and networks. Journal of Econometrics, 195 (1), 23–32. https://doi.org/10.1016/j.jeconom.2016.04.018 .

Kessler, M. M. (1963). Bibliographic coupling between scientific articles. American Documentation, 14 (1), 123–131.

Zarmpou, T., Saprikis, V., Markos, A., & Vlachopoulou, M. (2012). Modeling users’ acceptance of mobile services. Electronic Commerce Research, 12 (2), 225–248. https://doi.org/10.1007/s10660-012-9092-x .

Chaudhry, S. A., Farash, M. S., Naqvi, H., & Sher, M. (2016). A secure and efficient authenticated encryption for electronic payment systems using elliptic curve cryptography. Electronic Commerce Research, 16 (1), 113–139. https://doi.org/10.1007/s10660-015-9192-5 .

Antoniou, G., & Batten, L. (2011). E-commerce: Protecting purchaser privacy to enforce trust. Electronic Commerce Research, 11 (4), 421–456. https://doi.org/10.1007/s10660-011-9083-3 .

Morid, M. A., & Shajari, M. (2012). An enhanced e-commerce trust model for community based centralized systems. Electronic Commerce Research, 12 (4), 409–427. https://doi.org/10.1007/s10660-012-9099-3 .

Smith, R., & Shao, J. (2007). Privacy and e-commerce: A consumer-centric perspective. Electronic Commerce Research, 7 (2), 89–116. https://doi.org/10.1007/s10660-007-9002-9 .

Kshetri, N. (2013). Cybercrime and cyber-security issues associated with China: Some economic and institutional considerations. Electronic Commerce Research, 13 (1), 41–69. https://doi.org/10.1007/s10660-013-9105-4 .

Goh, T. T., & Sun, S. (2014). Exploring gender differences in Islamic mobile banking acceptance. Electronic Commerce Research, 14 (4), 435–458. https://doi.org/10.1007/s10660-014-9150-7 .

Chen, Y., & Chou, J. S. (2015). ECC-based untraceable authentication for large-scale active-tag RFID systems. Electronic Commerce Research, 15 (1), 97–120. https://doi.org/10.1007/s10660-014-9165-0 .

Isaac, J. T., Zeadally, S., & Cámara, J. S. (2012). A lightweight secure mobile payment protocol for vehicular ad-hoc networks (VANETs). Electronic Commerce Research, 12 (1), 97–123. https://doi.org/10.1007/s10660-011-9086-0 .

Jeffrey, S. A., & Hodge, R. (2007). Factors influencing impulse buying during an online purchase. Electronic Commerce Research, 7 (3–4), 367–379. https://doi.org/10.1007/s10660-007-9011-8 .

Biller, S., Chan, L. M. A., Simchi-Levi, D., & Swann, J. (2005). Dynamic pricing and the direct-to-customer model in the automotive industry. Electronic Commerce Research, 5 (2), 309–334. https://doi.org/10.1007/s10660-005-6161-4 .

Yan, R. (2008). Profit sharing and firm performance in the manufacturer-retailer dual-channel supply chain. Electronic Commerce Research, 8 (3), 155. https://doi.org/10.1007/s10660-008-9020-2 .

Cui, Y., Mou, J., & Liu, Y. (2018). Knowledge mapping of social commerce research: A visual analysis using CiteSpace. Electronic Commerce Research, 18 (4), 837–868. https://doi.org/10.1007/s10660-018-9288-9 .

Li, S., & Sun, W. (2016). A mechanism for resource pricing and fairness in peer-to-peer networks. Electronic Commerce Research, 16 (4), 425–451. https://doi.org/10.1007/s10660-016-9211-1 .

Wang, Z. B., Wang, Y. Y., & Wang, J. C. (2016). Optimal distribution channel strategy for new and remanufactured products. Electronic Commerce Research, 16 (2), 269–295. https://doi.org/10.1007/s10660-016-9225-8 .

Rofin, T. M., & Mahanty, B. (2018). Optimal dual-channel supply chain configuration for product categories with different customer preference of online channel. Electronic Commerce Research, 18 (3), 507–536. https://doi.org/10.1007/s10660-017-9269-4 .

Sila, I. (2013). Factors affecting the adoption of B2B e-commerce technologies. Electronic Commerce Research, 13 (2), 199–236. https://doi.org/10.1007/s10660-013-9110-7 .

Ozok, A. A., & Wei, J. (2010). An empirical comparison of consumer usability preferences in online shopping using stationary and mobile devices: Results from a college student population. Electronic Commerce Research, 10 (2), 111–137. https://doi.org/10.1007/s10660-010-9048-y .

Grace-Farfaglia, P., Dekkers, A., Sundararajan, B., Peters, L., & Park, S. H. (2006). Multinational web uses and gratifications: measuring the social impact of online community participation across national boundaries. Electronic Commerce Research, 6 (1), 75–101. https://doi.org/10.1007/s10660-006-5989-6 .

Chen, K., Jin, J., Zhao, Z., & Ji, P. (2020). Understanding customer regional differences from online opinions: A hierarchical Bayesian approach. Electronic Commerce Research (in press) . https://doi.org/10.1007/s10660-020-09420-5 .

Ma, Y., Chen, G., & Wei, Q. (2017). Finding users preferences from large-scale online reviews for personalized recommendation. Electronic Commerce Research, 17 (1), 3–29. https://doi.org/10.1007/s10660-016-9240-9 .

Yoon, S. H., & Kim, H. W. (2019). What content and context factors lead to selection of a video clip? The heuristic route perspective. Electronic Commerce Research, 19 (3), 603–627. https://doi.org/10.1007/s10660-019-09355-6 .

Pan, H., & Zhou, H. (2020). Study on convolutional neural network and its application in data mining and sales forecasting for e-commerce. Electronic Commerce Research, 20 (2), 297–320. https://doi.org/10.1007/s10660-020-09409-0 .

Pu, P., Chen, L., & Kumar, P. (2008). Evaluating product search and recommender systems for e-commerce environments. Electronic Commerce Research, 8 (1–2), 1–27. https://doi.org/10.1007/s10660-008-9015-z .

Panniello, U., & Gorgoglione, M. (2012). Incorporating context into recommender systems: An empirical comparison of context-based approaches. Electronic Commerce Research, 12 (1), 1–30. https://doi.org/10.1007/s10660-012-9087-7 .

Zhou, Q. (2018). Multi-layer affective computing model based on emotional psychology. Electronic Commerce Research, 18 (1), 109–124. https://doi.org/10.1007/s10660-017-9265-8 .

Suki, N. M. (2013). Consumer shopping behaviour on the Internet: Insights from Malaysia. Electronic Commerce Research, 13 (4), 477–491. https://doi.org/10.1007/s10660-013-9131-2 .

Chen, Y., Mullen, T., & Chu, C. H. (2006). An in-depth analysis of information markets with aggregate uncertainty. Electronic Commerce Research, 6 (2), 201–221. https://doi.org/10.1007/s10660-006-6958-9 .

Kang, H. G., Bae, K., Shin, J. A., & Jeon, S. (2020). Will data on internet queries predict the performance in the marketplace: An empirical study on online searches and IPO stock returns. Electronic Commerce Research (in press) . https://doi.org/10.1007/s10660-020-09417-0 .

Cui, Y., Mou, J., Cohen, J., & Liu, Y. (2019). Understanding information system success model and valence framework in sellers’ acceptance of cross-border e-commerce: A sequential multi-method approach. Electronic Commerce Research, 19 (4), 885–914. https://doi.org/10.1007/s10660-019-09331-0 .

Liu, S., Shao, B., Gao, Y., Hu, S., Li, Y., & Zhou, W. (2018). Game theoretic approach of a novel decision policy for customers based on big data. Electronic Commerce Research, 18 (2), 225–240. https://doi.org/10.1007/s10660-017-9259-6 .

Tian, X., & Liu, L. (2017). Does big data mean big knowledge? Integration of big data analysis and conceptual model for social commerce research. Electronic Commerce Research, 17 (1), 169–183. https://doi.org/10.1007/s10660-016-9242-7 .

Flanagin, A. J., Metzger, M. J., Pure, R., Markov, A., & Hartsell, E. (2014). Mitigating risk in ecommerce transactions: perceptions of information credibility and the role of user-generated ratings in product quality and purchase intention. Electronic Commerce Research, 14 (1), 1–23. https://doi.org/10.1007/s10660-014-9139-2 .

Fairlie, R. W. (2007). Explaining differences in access to home computers and the Internet: A comparison of Latino groups to other ethnic and racial groups. Electronic Commerce Research, 7 (3–4), 265–291. https://doi.org/10.1007/s10660-007-9006-5 .

Gerdes, J., Stringam, B. B., & Brookshire, R. G. (2008). An integrative approach to assess qualitative and quantitative consumer feedback. Electronic Commerce Research, 8 (4), 217–234. https://doi.org/10.1007/s10660-008-9022-0 .

Tsao, W. C., & Hsieh, M. T. (2015). eWOM persuasiveness: Do eWOM platforms and product type matter? Electronic Commerce Research, 15 (4), 509–541. https://doi.org/10.1007/s10660-015-9198-z .

Zhang, H., Rao, H., & Feng, J. (2018). Product innovation based on online review data mining: A case study of Huawei phones. Electronic Commerce Research, 18 (1), 3–22. https://doi.org/10.1007/s10660-017-9279-2 .

Liu, Q., Zhang, X., Zhang, L., & Zhao, Y. (2019). The interaction effects of information cascades, word of mouth and recommendation systems on online reading behavior: An empirical investigation. Electronic Commerce Research, 19 (3), 521–547. https://doi.org/10.1007/s10660-018-9312-0 .

Chen, R., & Xu, W. (2017). The determinants of online customer ratings: a combined domain ontology and topic text analytics approach. Electronic Commerce Research, 17 (1), 31–50. https://doi.org/10.1007/s10660-016-9243-6 .

Narayanasamy, K., Rasiah, D., & Tan, T. M. (2011). The adoption and concerns of e-finance in Malaysia. Electronic Commerce Research, 11 (4), 383–400. https://doi.org/10.1007/s10660-011-9081-5 .

Dumas, M., Aldred, L., Governatori, G., & Ter Hofstede, A. H. M. (2005). Probabilistic automated bidding in multiple auctions. Electronic Commerce Research, 5 (1), 25–49. https://doi.org/10.1023/B:ELEC.0000045972.75533.90 .

Marinč, M. (2013). Banks and information technology: Marketability vs. relationships. Electronic Commerce Research, 13 (1), 71–101. https://doi.org/10.1007/s10660-013-9107-2 .

Maillé, P., Markakis, E., Naldi, M., Stamoulis, G. D., & Tuffin, B. (2012). Sponsored search auctions: An overview of research with emphasis on game theoretic aspects. Electronic Commerce Research, 12 (3), 265–300. https://doi.org/10.1007/s10660-012-9094-8 .

Maillé, P., & Tuffin, B. (2018). Auctions for online ad space among advertisers sensitive to both views and clicks. Electronic Commerce Research, 18 (3), 485–506. https://doi.org/10.1007/s10660-017-9267-6 .

Håvaldsrud, T. V., Ligaarden, O. S., Myrseth, P., Refsdal, A., Stølen, K., & Ølnes, J. (2010). Experiences from using a UML-based method for trust analysis in an industrial project on electronic procurement. Electronic Commerce Research, 10 (3–4), 441–467. https://doi.org/10.1007/s10660-010-9063-z .

Dráb, R., Štofa, T., & Delina, R. (2020). Analysis of the efficiency of electronic reverse auction settings: Big data evidence. Electronic Commerce Research (in press) . https://doi.org/10.1007/s10660-020-09433-0 .

Bei, L. T., & Chen, M. Y. (2015). The effects of hedonic and utilitarian bidding values on e-auction behavior. Electronic Commerce Research, 15 (4), 483–507. https://doi.org/10.1007/s10660-015-9197-0 .

Huang, T. L., & Liao, S. (2015). A model of acceptance of augmented-reality interactive technology: The moderating role of cognitive innovativeness. Electronic Commerce Research, 15 (2), 269–295. https://doi.org/10.1007/s10660-014-9163-2 .

Hsieh, J. K., Hsieh, Y. C., & Tang, Y. C. (2012). Exploring the disseminating behaviors of eWOM marketing: Persuasion in online video. Electronic Commerce Research, 12 (2), 201–224. https://doi.org/10.1007/s10660-012-9091-y .

Zhang, L., Luo, M., & Boncella, R. J. (2020). Product information diffusion in a social network. Electronic Commerce Research, 20 (1), 3–19. https://doi.org/10.1007/s10660-018-9316-9 .

Zhanikeev, M. (2015). How variable bitrate video formats can help P2P streaming boost its reliability and scale. Electronic Commerce Research, 15 (1), 25–47. https://doi.org/10.1007/s10660-015-9175-6 .

Cheng, X., Gu, Y., & Mou, J. (2020). Interpersonal relationship building in social commerce communities: Considering both swift guanxi and relationship commitment. Electronic Commerce Research, 20 (1), 53–80. https://doi.org/10.1007/s10660-019-09375-2 .

Chu, X., Liu, Y., Chen, X., Ding, Z., & Tao, S. (2020). What motivates consumer to engage in microblogs? The roles of brand post characteristics and brand prestige. Electronic Commerce Research (in press). https://doi.org/10.1007/s10660-020-09435-y .

Zhou, T. (2013). An empirical examination of user adoption of location-based services. Electronic Commerce Research, 13 (1), 25–39. https://doi.org/10.1007/s10660-013-9106-3 .

Chen, Q., Chen, H. M., & Kazman, R. (2007). Investigating antecedents of technology acceptance of initial ECRM users beyond generation X and the role of self-construal. Electronic Commerce Research, 7 (3–4), 315–339. https://doi.org/10.1007/s10660-007-9009-2 .

Royo, S., & Yetano, A. (2015). “Crowdsourcing” as a tool for e-participation: Two experiences regarding CO 2 emissions at municipal level. Electronic Commerce Research, 15 (3), 323–348. https://doi.org/10.1007/s10660-015-9183-6 .

Chen, D., Li, X., & Lai, F. (2017). Gender discrimination in online peer-to-peer credit lending: Evidence from a lending platform in China. Electronic Commerce Research, 17 (4), 553–583. https://doi.org/10.1007/s10660-016-9247-2 .

Yu, C. H., & Lin, S. J. (2013). Fuzzy rule optimization for online auction frauds detection based on genetic algorithm. Electronic Commerce Research, 13 (2), 169–182. https://doi.org/10.1007/s10660-013-9113-4 .

Yan, Y., Lv, Z., & Hu, B. (2018). Building investor trust in the P2P lending platform with a focus on Chinese P2P lending platforms. Electronic Commerce Research, 18 (2), 203–224. https://doi.org/10.1007/s10660-017-9255-x .

Guo, Y., & Barnes, S. (2009). Virtual item purchase behavior in virtual worlds: An exploratory investigation. Electronic Commerce Research, 9 (1–2), 77–96. https://doi.org/10.1007/s10660-009-9032-6 .

Bourlakis, M., Papagiannidis, S., & Li, F. (2009). Retail spatial evolution: Paving the way from traditional to metaverse retailing. Electronic Commerce Research, 9 (1–2), 135–148. https://doi.org/10.1007/s10660-009-9030-8 .

MacInnes, I. (2006). Property rights, legal issues, and business models in virtual world communities. Electronic Commerce Research, 6 (1), 39–56. https://doi.org/10.1007/s10660-006-5987-8 .

Cagnina, M. R., & Poian, M. (2009). Beyond e-business models: The road to virtual worlds. Electronic Commerce Research, 9 (1–2), 49–75. https://doi.org/10.1007/s10660-009-9027-3 .

Scarle, S., Arnab, S., Dunwell, I., Petridis, P., Protopsaltis, A., & de Freitas, S. (2012). E-commerce transactions in a virtual environment: Virtual transactions. Electronic Commerce Research, 12 (3), 379–407. https://doi.org/10.1007/s10660-012-9098-4 .

Hanafizadeh, P., & Khedmatgozar, H. R. (2012). The mediating role of the dimensions of the perceived risk in the effect of customers’ awareness on the adoption of Internet banking in Iran. Electronic Commerce Research, 12 (2), 151–175. https://doi.org/10.1007/s10660-012-9090-z .

Valvi, A. C., & Fragkos, K. C. (2012). Critical review of the e-loyalty literature: A purchase-centred framework. Electronic Commerce Research, 12 (3), 331–378. https://doi.org/10.1007/s10660-012-9097-5 .

Aloudat, A., & Michael, K. (2011). Toward the regulation of ubiquitous mobile government: A case study on location-based emergency services in Australia. Electronic Commerce Research, 11 (1), 31–74. https://doi.org/10.1007/s10660-010-9070-0 .

Tsai, H. T., Chien, J. L., & Tsai, M. T. (2014). The influences of system usability and user satisfaction on continued Internet banking services usage intention: Empirical evidence from Taiwan. Electronic Commerce Research, 14 (2), 137–169. https://doi.org/10.1007/s10660-014-9136-5 .

Li, H., Aham-Anyanwu, N., Tevrizci, C., & Luo, X. (2015). The interplay between value and service quality experience: E-loyalty development process through the eTailQ scale and value perception. Electronic Commerce Research, 15 (4), 585–615. https://doi.org/10.1007/s10660-015-9202-7 .

Khedmatgozar, H. R., & Shahnazi, A. (2018). The role of dimensions of perceived risk in adoption of corporate internet banking by customers in Iran. Electronic Commerce Research, 18 (2), 389–412. https://doi.org/10.1007/s10660-017-9253-z .

Zhou, R., Wang, X., Shi, Y., Zhang, R., Zhang, L., & Guo, H. (2019). Measuring e-service quality and its importance to customer satisfaction and loyalty: an empirical study in a telecom setting. Electronic Commerce Research, 19 (3), 477–499. https://doi.org/10.1007/s10660-018-9301-3 .

Kim, J. B. (2012). An empirical study on consumer first purchase intention in online shopping: Integrating initial trust and TAM. Electronic Commerce Research, 12 (2), 125–150. https://doi.org/10.1007/s10660-012-9089-5 .

Gregg, D. G., & Walczak, S. (2010). The relationship between website quality, trust and price premiums at online auctions. Electronic Commerce Research, 10 (1), 1–25. https://doi.org/10.1007/s10660-010-9044-2 .

Taylor, D. G., Davis, D. F., & Jillapalli, R. (2009). Privacy concern and online personalization: The moderating effects of information control and compensation. Electronic Commerce Research, 9 (3), 203–223. https://doi.org/10.1007/s10660-009-9036-2 .

Castañeda, J. A., & Montoro, F. J. (2007). The effect of Internet general privacy concern on customer behavior. Electronic Commerce Research, 7 (2), 117–141. https://doi.org/10.1007/s10660-007-9000-y .

Chen, M. Y., & Teng, C. I. (2013). A comprehensive model of the effects of online store image on purchase intention in an e-commerce environment. Electronic Commerce Research, 13 (1), 1–23. https://doi.org/10.1007/s10660-013-9104-5 .

Goel, L., & Prokopec, S. (2009). If you build it will they come? An empirical investigation of consumer perceptions and strategy in virtual worlds. Electronic Commerce Research, 9 (1–2), 115–134. https://doi.org/10.1007/s10660-009-9031-7112 .

Ninia, J. (2020). The impact of e-commerce: China versus the United States . Ithaca, New York: Cornell University.

Google Scholar  

IBM Research. (2020). Our labs. IBM . Available at https://www.research.ibm.com/labs/

Klein, J. T., & Falk-Krzesinski, H. J. (2017). Interdisciplinary and collaborative work: Framing promotion and tenure practices and policies. Research Policy, 46 (6), 1055–1061. https://doi.org/10.1016/j.respol.2017.03.001 .

Lim, W. M. (2019). To what degree is the fourth industrial revolution an opportunity or a threat for the ASEAN community and region? Modern Applied Science, 13 (9), 105–106. https://doi.org/10.5539/mas.v13n9p105 .

Wijaya, D. R., Paramita, N. L. P. S. P., Uluwiyah, A., Rheza, M., Zahara, A., & Puspita, D. R. (2021). Estimating city-level poverty rate based on e-commerce data with machine learning. Electronic Commerce Research . https://doi.org/10.1007/s10660-020-09424- .

Lim, W. M. (2020). Challenger marketing. Industrial Marketing Management, 84, 342–345. https://doi.org/10.1016/j.indmarman.2019.08.009 .

Lim, W. M. (2020). In defense of challenger marketing. Journal of Business-to-Business Marketing, 27 (4), 397–406. https://doi.org/10.1080/1051712X.2020.1831214 .

Lim, W. M. (2020). The sharing economy: A marketing perspective. Australasian Marketing Journal, 28 (3), 4–13. https://doi.org/10.1016/j.ausmj.2020.06.007 .

Lim, W. M. (2016). Understanding the selfie phenomenon: Current insights and future research directions. European Journal of Marketing, 50 (9/10), 1773–1788. https://doi.org/10.1108/EJM-07-2015-0484 .

Lim, W. M. (2018). Demystifying neuromarketing. Journal of Business Research, 91, 205–220. https://doi.org/10.1016/j.jbusres.2018.05.036 .

Lim, W. M. (2018). Dialectic antidotes to critics of the technology acceptance model: Conceptual, methodological, and replication treatments for behavioural modelling in technology-mediated environments. Australasian Journal of Information Systems . https://doi.org/10.3127/ajis.v22i0.1651 .

Lim, W. M. (2018). What will business-to-business marketers learn from neuro-marketing? Insights for business marketing practice. Journal of Business-to-Business Marketing, 25 (3), 251–259. https://doi.org/10.1080/1051712X.2018.1488915 .

Lim, W. M., Ahmed, P. K., & Ali, M. Y. (2019). Data and resource maximization in business-to-business marketing experiments: Methodological insights from data partitioning. Industrial Marketing Management, 76, 136–143. https://doi.org/10.1016/j.indmarman.2018.08.007 .

Lim, W. M., Yap, S. F., & Makkar, M. (2021). Home sharing in marketing and tourism at a tipping point: What do we know, how do we know, and where should we be heading? Journal of Business Research, 122, 534–566. https://doi.org/10.1108/EJM-07-2015-0484 .

Download references

Author information

Authors and affiliations.

Department of Management Studies, Malaviya National Institute of Technology, Jaipur, Rajasthan, 302017, India

Satish Kumar & Nitesh Pandey

Swinburne Business School, Swinburne University of Technology, John Street, Hawthorn, Victoria, 3122, Australia

Weng Marc Lim

School of Business, Swinburne University of Technology, Jalan Simpang Tiga, 93350, Kuching, Sarawak, Malaysia

Department of Information and Decision Sciences, University of Illinois – Chicago, 601 S. Morgan Street, Chicago, Illinois, 60607-7124, USA

J. Christopher Westland

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Satish Kumar .

Ethics declarations

Conflict of interest.

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Kumar, S., Lim, W.M., Pandey, N. et al. 20 years of Electronic Commerce Research . Electron Commer Res 21 , 1–40 (2021). https://doi.org/10.1007/s10660-021-09464-1

Download citation

Accepted : 01 February 2021

Published : 29 March 2021

Issue Date : March 2021

DOI : https://doi.org/10.1007/s10660-021-09464-1

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Electronic commerce research
  • Bibliometric analysis
  • Performance analysis
  • Co-authorship analysis
  • Bibliographic coupling
  • Temporal keyword analysis
  • Find a journal
  • Publish with us
  • Track your research
  • More Blog Popular
  • Who's Who Legal
  • Instruct Counsel
  • My newsfeed
  • Save & file
  • View original
  • Follow Please login to follow content.

add to folder:

  • My saved (default)

Register now for your free, tailored, daily legal newsfeed service.

Find out more about Lexology or get in touch by visiting our About page.

80 WTO Members Reach Initial Agreement in E-Commerce Negotiations

Greenberg Traurig LLP logo

After five years of negotiations, 80 member countries of the World Trade Organization (WTO) reached an historic result on cross-border e-commerce, agreeing on a draft of common guidelines and rules applicable to global e-commerce operations. Certain countries, including the United States, are not yet on board.

This initiative, made public July 26, 2024, seeks to establish standards to facilitate the flow of goods and services between countries, promoting cooperation among authorities and seeking to reduce barriers for a commercial modality that has grown exponentially in recent years.

As a result of negotiations that involved more than 90 countries which, according to the WTO, represent 90% of global trade, the organization published a “stabilized” text, which must still reach a general consensus before entering the operational phase. The main points of the agreement include the following:

Enabling Electronic Commerce

WTO member countries would agree to maintain legal frameworks aligned with the principles of the 1996 UNCITRAL Model Law on Electronic Commerce, which guarantees equal treatment between electronic and paper-based information, promoting efficiency in international trade.

According to the draft, the countries would agree to recognize the legal effects, legal validity, or enforceability of contracts or documents that have been executed through electronic means, thereby guaranteeing their legal effect, equivalent to that of those executed in traditional formats.

The member countries would commit to avoiding unnecessary regulatory burdens and to promoting continuous improvement in e-commerce regulation, seeking the recognition and adoption of electronic transferable documents, definition of key concepts such as authentication and electronic signature, and promotion of the interoperability and recognition of electronic signatures between authorities of different jurisdictions.

Paperless Trade

The agreement promotes the transition to a paperless cross-border trade environment by encouraging countries to eliminate physical forms and documents in customs and trade processes and to replace them with electronic, data-based documents. It focuses on international cooperation to promote the adoption of electronic documentation in foreign trade.

The agreement also calls for countries’ electronic platforms for foreign trade operations, known as single windows, to allow the advance submission of documents to facilitate processing before goods arrive in their territories, guaranteeing the protection and confidentiality of data.

Electronic Payments and Invoicing

Due to the growth in the volume of electronic transfers to settle monetary obligations stemming from international transactions, WTO members also seek to establish common ground to address this phenomenon, seeking secure, efficient, accessible, and competitive payments based on international standards, as well as promote interoperability in electronic payment services.

Consumer Protection and Cybersecurity

Given that the exponential growth of e-commerce has led to an increase in illegal and misleading activities that put consumers at risk, the agreement defines “misleading commercial activities” as those that may mislead or defraud in relation to the characteristics, prices, suitability, quantity, or origin of goods or services. To combat such risks, countries would commit to adopting measures to ensure fair treatment of consumers and to ensure that protection in e-commerce is equivalent to that offered in other traditional modes of commerce.

In addition, the agreement would compel states to promote access to remedy mechanisms for consumers in cross-border transactions, to limit unsolicited commercial emails, and to effectively protect personal data. Regarding cybersecurity, the countries agreed to develop national incident response capabilities and collaborate in identifying and mitigating cyber threats.

WTO members must still reach consensus and vote on the agreement’s content and scope. The WTO has made the text public on behalf of the participating countries, with the exception of certain states such as Brazil, the United States, Colombia, Indonesia, and Turkey, all of which are important players in the international trade arena. Therefore, the agreement is in an operational phase while WTO members deliberate and approve.

While not yet finalized, this initiative on e-commerce, which includes positions on other issues such as telecommunications and development, represents a significant global effort to adapt and harmonize international regulations to the realities of digital commerce.

Filed under

  • IT & Data Protection
  • Trade & Customs
  • Greenberg Traurig LLP

Organisations

  • World Trade Organization
  • Platforms & online marketplaces

Popular articles from this firm

Difference between club and hotel management agreements *, brand safety alliance rolls out globalblock domain name blocking service *, are law firms considered “processors” or “controllers” of the personal data that they collect from third parties as part of a representation of a client *, understanding ai terms: what is input data *, understanding ai terms: what is output data *.

If you would like to learn how Lexology can drive your content marketing strategy forward, please email [email protected] .

Powered by Lexology

Related practical resources PRO

  • How-to guide How-to guide: How to develop, implement and maintain a US information and data security compliance program (USA)
  • Checklist Checklist: Completing a data incident response plan assessment (USA)
  • How-to guide How-to guide: How to manage your organization’s data privacy and security risks (USA)

Related research hubs

electronic commerce research

IMAGES

  1. Electronic Commerce Research

    electronic commerce research

  2. Electronic Commerce Research

    electronic commerce research

  3. A Short History of Digital Commerce and Five Trends to Watch in the

    electronic commerce research

  4. 10.6. E-Commerce Models

    electronic commerce research

  5. (PDF) Journal of Electronic Commerce Research

    electronic commerce research

  6. Electronic Commerce Research and Application

    electronic commerce research

VIDEO

  1. 10

  2. VCW Introduction: How did the idea for the VCW emerge?

  3. COMMERCE : Research highlight : 05 February 2024

  4. Electronic commerce is the future✨💖

  5. Commerce : Research Highlights : 14 September 2023

  6. Maximizing ecommerce profitability for long term growth: Winning strategies from top retailers

COMMENTS

  1. Home

    Electronic Commerce Research is a peer-reviewed journal that publishes theoretical and empirical research on e-commerce. It covers topics such as AI, big data, green supply chain, consumer happiness, and cybersecurity.

  2. ECRA

    ECRA is a peer-reviewed journal that publishes papers on various topics related to e-commerce, such as technology, business, policy, and analytics. It aims to create and disseminate enduring knowledge for the fast-changing e-commerce environment and invites proposals for special issues on new topics.

  3. Volumes and issues

    Search all Electronic Commerce Research articles Volume 24 March - June 2024 Mar - Jun 2024. Issue 2 June 2024. Special Issue : Online Grocery Shopping. Issue 1 March 2024. SI: Electronic Commerce in Finance. Volume 23 March - December 2023 Mar - Dec 2023. Issue 4 December 2023; Issue 3 September 2023.

  4. Articles

    Browse the latest articles on e-commerce research from various perspectives, such as marketing, technology, psychology, and management. Find out the aims, scope, and editorial board of the journal, as well as the submission guidelines and updates.

  5. International Journal of Electronic Commerce

    The International Journal of Electronic Commerce is the leading refereed quarterly devoted to advancing the understanding and practice of electronic commerce. It serves the needs of researchers as well as practitioners and executives involved in electronic commerce. The Journal aims to offer an integrated view of the field by presenting approaches of multiple disciplines.

  6. JECR-Journal of Electronic Commerce Research

    JECR is a peer-reviewed journal that publishes research on e-commerce topics. The current issue features articles on grammar and syntax, customer satisfaction, social media influencers, and a special issue on artificial general intelligence in e-commerce.

  7. Electronic Commerce Research

    A peer-reviewed journal published by Springer Science+Business Media that covers all aspects of electronic commerce. The journal has an impact factor of 3.7 and is indexed in various databases and platforms.

  8. Guide for authors

    Electronic Commerce Research and Applications aims to create and disseminate enduring knowledge for the fast-changing e-commerce environment. A major dilemma in e-commerce research is how to achieve a balance between the currency and the life span of knowledge. Electronic Commerce Research and Applications will contribute to the establishment ...

  9. Electronic Commerce Research and Applications

    A peer-reviewed journal that publishes research on e-commerce technologies, theory, applications, and policy. Covers topics such as agent-based commerce, big data analytics, social media, digital economy, e-government, and more.

  10. ECRA

    A collection of research articles on various topics in e-commerce, such as platform advertising, service quality, personalization, live streaming, co-creation, recommendation systems, and more. The articles are published in the journal Electronic Commerce Research and Applications, a peer-reviewed scholarly platform by Elsevier.

  11. 20 years of Electronic Commerce Research

    2021 marks the 20th anniversary of the founding of Electronic Commerce Research ( ECR ). The journal has changed substantially over its life, reflecting the wider changes in the tools and commercial focus of electronic commerce. ECR 's early focus was telecommunications and electronic commerce. After reorganization and new editorship in 2014 ...

  12. Insights

    A peer-reviewed journal that publishes research on e-commerce topics such as information systems, marketing, artificial intelligence, and computer networks. Learn about the aims, scope, impact, and publishing options of this journal.

  13. ELECTRONIC COMMERCE RESEARCH AND APPLICATIONS Home

    Information transmit strategy of e-commerce platform with financially constrained supplier. Zhaobo Chen. Research Center for Innovation and Development of Equipment Manufacturing Industry, Taiyuan University of Science and Technology, Taiyuan 030024, China

  14. Journal of Theoretical and Applied Electronic Commerce Research

    Journal of Theoretical and Applied Electronic Commerce Research published since 2006, is an international, peer-reviewed, scientific journal owned by the Faculty of Engineering of the Universidad de Talca, and MDPI provides publishing services for the journal since Volume 16, Issue 3 (2021).. Open Access — free for readers, with article processing charges (APC) paid by authors or their ...

  15. Economics and Electronic Commerce

    Economics and Electronic Commerce. Google is a global leader in electronic commerce. Not surprisingly, considerable attention is devoted to research in this area. Topics include 1) auction design, 2) advertising effectiveness, 3) statistical methods, 4) forecasting and prediction, 5) survey research, 6) policy analysis and a host of other topics.

  16. 20 years of Electronic Commerce Research

    Abstract. 2021 marks the 20th anniversary of the founding of Electronic Commerce Research ( ECR ). The journal has changed substantially over its life, reflecting the wider changes in the tools and commercial focus of electronic commerce. ECR 's early focus was telecommunications and electronic commerce. After reorganization and new ...

  17. Aims and scope

    Electronic Commerce Research is a hybrid journal that publishes theoretical and empirical research on all facets of electronic commerce and its implications. The journal covers topics such as Internet services, intelligent agents, global impact, fraud reduction, security, payment systems, marketing, legal issues, and more.

  18. JTAER

    All articles published in Journal of Theoretical and Applied Electronic Commerce Research (ISSN 0718-1876) are published in full open access.An article processing charge (APC) of CHF 1000 (Swiss Francs) applies to papers accepted after peer review. This article processing charge is to cover the costs of peer review, copyediting, typesetting, long-term archiving, and journal management.

  19. Volume 23, Issue 1

    Author Correction: Online Advertising and Real Estate sales: evidence from the Housing Market. Xiuzhi Zhang. Ying Zhang. Zhijie Lin. Author Correction Open access 06 March 2023 Pages: 631 - 631. Volume 23, issue 1 articles listing for Electronic Commerce Research.

  20. Introduction to Electronic Commerce and Social Commerce

    This is a complete update of the best-selling undergraduate textbook on Electronic Commerce (EC). New to this 4th Edition is the addition of material on Social Commerce (two chapters); a new tutorial on the major EC support technologies, including cloud computing, RFID, and EDI; ten new learning outcomes; and video exercises added to most chapters. Wherever appropriate, material on Social ...

  21. Research on E-commerce Precision Marketing Strategy Based on Big Data

    In recent years, the development of e-commerce platforms has been gaining momentum, which has made the mining and marketing of e-commerce data more and more critical. Major e-commerce platforms and companies are starting to analyse basic information about their customers, extracting useful information from it, accurately screening customer needs and finally developing targeted marketing ...

  22. Regular Issue

    JOURNAL OF ELECTRONIC COMMERCE RESEARCH. College of Business - California State University Long Beach . 1250 Bellflower Blvd, Long Beach, CA 90840. Hosted & Printed by College of Commerce, National Chengchi University. 64, Sec. 2, ZhiNan Rd., Taipei, Taiwan 11605.

  23. ELECTRONIC COMMERCE IN THE AGE OF DIGITALIZATION

    ELECTRONIC COMMERCE IN THE AGE OF DIGITALIZATION. May 2020. Black Sea Economic Studies. DOI: 10.32843/bses.53-8. Authors: Olena Vynogradova. Natalia Yevtushenko. Iryna Krjuchok. To read the full ...

  24. Investigating LLM Applications in E-Commerce

    Our contributions are as follows: 1) Organizing and formatting four e-commerce datasets for the evaluation of large language models (LLMs). 2) Conducting comprehensive experiments to compare fine-tuning a large language model with conventional industrial baselines, such as BERT and T5, using varying amounts of data for e-commerce tasks; additionally, we examine the effectiveness of in-context ...

  25. 20 years of Electronic Commerce Research

    2021 marks the 20th anniversary of the founding of Electronic Commerce Research (ECR). The journal has changed substantially over its life, reflecting the wider changes in the tools and commercial focus of electronic commerce. ECR's early focus was telecommunications and electronic commerce. After reorganization and new editorship in 2014, that focus expanded to embrace emerging tools ...

  26. Barriers to Entry in China's Consumer Goods E-Commerce Market

    Our research attempts to provide a theoretical basis for China's consumer goods e-commerce market entry barriers. Practical implications Studying market entry barriers can help firms better adapt to market changes, optimize their operational modes according to market demands and norms, and enhance their competitiveness.

  27. Cross-border E-commerce Logistics Market Size Report 2030

    The global cross-border e-commerce logistics market size was estimated at USD 97.85 billion in 2023 and is projected to grow at a CAGR of 25.4% from 2024 to 2030. The market growth can be attributed to the rapid expansion of online retail, cross-border trade, and advancements in logistics technology. ... Grand View Research has segmented the ...

  28. 80 WTO Members Reach Initial Agreement in E-Commerce ...

    After five years of negotiations, 80 member countries of the World Trade Organization (WTO) reached an historic result on cross-border e-commerce, agreeing on a draft of common guidelines and ...