Daniel Abadi's Publications

Conference and Journal Publications

• C5: Cloned Concurrency Control That Always Keeps Up
  Jeffrey Helt, Abhinav Sharma, Daniel J. Abadi, Wyatt Lloyd, and Jose M. Faleiro. PVLDB 16(1), 2022. (bibtex)


• BullFrog: Online Schema Evolution via Lazy Evaluation
  Souvik Bhattacherjee, Gang Liao, Michael Hicks, and Daniel J. Abadi. In Proceedings of SIGMOD, 2021. (bibtex)


• AnyLog: a Grand Unification of the Internet of Things
  Daniel J. Abadi, Owen Arden, Faisal Nawab, and Moshe Shadmon. In Proceedings of CIDR, 2020. (bibtex)


• Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology
  Azza Abouzied, Daniel J. Abadi, Kamil Bajda-Pawlikowski, and Avi Silberschatz. PVLDB 12(12), 2019. (bibtex)


• SLOG: Serializable, Low-latency, Geo-replicated Transactions
  Kun Ren, Dennis Li, and Daniel J. Abadi. PVLDB 12(11), 2019. (bibtex)


• An Overview of Deterministic Database Systems
  Daniel J. Abadi and Jose M. Faleiro. CACM, 61(9), September 2018. (bibtex)


• The FuzzyLog: A Partially Ordered Shared Log
  Joshua Lockerman, Jose M. Faleiro, Juno Kim, Soham Sankaran, Daniel J. Abadi, James Aspnes, Siddhartha Sen, and Mahesh Balakrishnan. In Proceedings of OSDI, 2018. (bibtex)


• High Performance Transactions via Early Write Visibility
  Jose M. Faleiro, Daniel J. Abadi, and Joseph M. Hellerstein. PVLDB 10(5): 613-624, 2017. (bibtex)


• Latch-free Synchronization in Database Systems: Silver Bullet or Fool's Gold?
  Jose M. Faleiro and Daniel J. Abadi. In Proceedings of CIDR, 2017. (bibtex)


• Automatic Generation of Normalized Relational Schemas from Nested Key-Value Data
  Michael DiScala and Daniel J. Abadi. In Proceedings of SIGMOD, 2016. (bibtex)


• Design Principles for Scaling Multi-core OLTP Under High Contention
  Kun Ren, Jose Faleiro, and Daniel J. Abadi. In Proceedings of SIGMOD, 2016. (bibtex)


• Low-Overhead Asynchronous Checkpointing in Main-Memory Database Systems
  Kun Ren, Thaddeus Diamond, Daniel J. Abadi, and Alexander Thomson. In Proceedings of SIGMOD, 2016. (bibtex)


• Scalable Pattern Matching Over Compressed Graphs via Dedensification
  Antonio Maccioni and Daniel J. Abadi. In Proceedings of KDD, 2016. (bibtex)


• LEOPARD: Lightweight Edge-Oriented Partitioning and Replication for Dynamic Graphs
  Jiewen Huang and Daniel J. Abadi. PVLDB 9(7): 540-551, 2016. (bibtex)


• VLL: A Lock Manager Redesign for Main Memory Database Systems
  Kun Ren, Alexander Thomson, and Daniel J. Abadi. VLDB Journal 24(5): 681-705, October 2015. (bibtex)


• Rethinking serializable multiversion concurrency control
  Jose M. Faleiro and Daniel J. Abadi. PVLDB 8(11): 1190-1201, 2015. (bibtex)


• CalvinFS: Consistent WAN Replication and Scalable Metadata Management for Distributed File Systems
  Alexander Thomson and Daniel J. Abadi. In Proceedings of FAST, 2015. (bibtex)


• FIT: A Distributed Database Performance Tradeoff
  Jose M. Faleiro and Daniel J. Abadi. IEEE Data Engineering Bulletin, 38(1): 10-17, 2015. (bibtex)


• Lazy Evaluation of Transactions in Database Systems
  Jose Faleiro, Alexander Thomson, and Daniel J. Abadi. In Proceedings of SIGMOD, 2014. (bibtex)


• Sinew: a SQL System for Unified Analytics of Multi-structured Data
  Daniel Tahara, Thaddeus Diamond, and Daniel J. Abadi. In Proceedings of SIGMOD, 2014. (bibtex)


• An Evaluation of the Advantages and Disadvantages of Deterministic Database Systems
  Kun Ren, Alexander Thomson, and Daniel J. Abadi. PVLDB 7(10): 821-832, 2014. (bibtex)


• Fast Distributed Transactions and Strongly Consistent Replication for OLTP Database Systems
  Alexander Thomson, Thaddeus Diamond, Shu-Chun Weng, Kun Ren, Philip Shao, and Daniel J. Abadi. ACM TODS 39(2): 11, 2014. (bibtex)


• Query Optimization of Distributed Pattern Matching
  Jiewen Huang, Kartik Venkatraman, and Daniel J. Abadi. In Proceedings of ICDE, 2014. (bibtex)


• The Beckman Report on Database Research
  Daniel J. Abadi, Rakesh Agrawal, Anastasia Ailamaki, Magdalena Balazinska, Philip A. Bernstein, Michael J. Carey, Surajit Chaudhuri, Jeffrey Dean, AnHai Doan, Michael J. Franklin, Johannes Gehrke, Laura M. Haas, Alon Y. Halevy, Joseph M. Hellerstein, Yannis E. Ioannidis, H. V. Jagadish, Donald Kossmann, Samuel Madden, Sharad Mehrotra, Tova Milo, Jeffrey F. Naughton, Raghu Ramakrishnan, Volker Markl, Christopher Olston, Beng Chin Ooi, Christopher Re, Dan Suciu, Michael Stonebraker, Todd Walter, and Jennifer Widom. SIGMOD Record, 43(3): 61-70, 2014. (bibtex)


• Modularity and Scalability in Calvin
  Alexander Thomson and Daniel J. Abadi. IEEE Data Engineering Bulletin, 36(2): 48-55, 2013. (bibtex)


• The Design and Implementation of Modern Column-Oriented Database Systems
  Daniel Abadi, Peter Boncz, Stavros Harizopoulos, Stratos Idreos, and Samuel Madden. Foundations and Trends in Databases, 5(3): 197-280, 2013. (bibtex)


• Invisible Loading: Access-Driven Data Transfer from Raw Files into Database Systems
  Azza Abouzied, Daniel J. Abadi, and Avi Silberschatz. In Proceedings of EDBT, 2013. (bibtex)


• Lightweight Locking for Main Memory Database Systems
  Kun Ren, Alexander Thomson, and Daniel J. Abadi. PVLDB 6(2): 145-156, 2012. (bibtex)


• Consistency Tradeoffs in Modern Distributed Database System Design: CAP is Only Part of the Story
  Daniel J. Abadi. IEEE Computer, 45(2), 2012. (bibtex)


• Calvin: Fast Distributed Transactions for Partitioned Database Systems
  Alexander Thomson, Thaddeus Diamond, Shu-Chun Weng, Kun Ren, Philip Shao, and Daniel J. Abadi. In Proceedings of SIGMOD, 2012. (bibtex)


• Scalable SPARQL Querying of Large RDF Graphs
  Jiewen Huang, Daniel J. Abadi, and Kun Ren. PVLDB, 4(21), August 2011. (bibtex)


• Efficient Processing of Data Warehousing Queries in a Split Execution Environment
  Kamil Bajda-Pawlikowski, Daniel J. Abadi, Avi Silberschatz, and Erik Paulson. In Proceedings of SIGMOD, 2011. (bibtex)


• Building Deterministic Transaction Processing Systems without Deterministic Thread Scheduling
  Alexander Thomson and Daniel J. Abadi. Workshop Paper, WODET, 2011. (bibtex)


• The Case for Determinism in Database Systems
  Alexander Thomson and Daniel J. Abadi. PVLDB, 3(1), September 2010. (bibtex)


• MapReduce and Parallel DBMSs: Friends or Foes?
  Michael Stonebraker, Daniel J. Abadi, David. J. DeWitt, Samuel Madden, Erik Paulson, Andrew Pavlo, and Alexander Rasin. CACM, 53(1), January 2010. (bibtex)


• Low Overhead Concurrency Control for Partitioned Main Memory Databases
  Evan P. C. Jones, Daniel J. Abadi, and Samuel Madden. In Proceedings of SIGMOD, 2010. (bibtex)


• HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads
  Azza Abouzied, Kamil Bajda-Pawlikowski, Daniel J. Abadi, Avi Silberschatz, and Alexander Rasin. PVLDB, 2(1), August 2009. VLDB Test of Time Award (bibtex)


• SW-Store: A Vertically Partitioned DBMS for Semantic Web Data Management
  Daniel J. Abadi, Adam Marcus, Samuel R. Madden, and Kate Hollenbach. VLDB Journal, 18(2), April 2009. (bibtex)


• Data Management in the Cloud: Limitations and Opportunities
  Daniel J. Abadi. IEEE Data Engineering Bulletin, 32(1), March 2009. (bibtex)


• A Comparison of Approaches to Large Scale Data Analysis
  Andrew Pavlo, Erik Paulson, Alexander Rasin, Daniel J. Abadi, David J. DeWitt, Samuel R. Madden, and Michael Stonebraker. In Proceedings of SIGMOD, 2009. (bibtex)


• Column-Stores vs. Row-Stores: How Different Are They Really?
  Daniel J. Abadi, Samuel R. Madden, and Nabil Hachem. In Proceedings of SIGMOD, 2008. (bibtex)


• OLTP Through the Looking Glass, And What We Found There
  Stavros Harizopoulos, Daniel J. Abadi, Samuel R. Madden, and Michael Stonebraker. In Proceedings of SIGMOD, 2008. (bibtex)


• Scalable Semantic Web Data Management Using Vertical Partitioning
  Daniel J. Abadi, Adam Marcus, Samuel R. Madden, and Kate Hollenbach. In Proceedings of VLDB, 2007. Best Paper Award (bibtex)


• The End of an Architectural Era (It's Time for a Complete Rewrite)
  Michael Stonebraker, Samuel R. Madden, Daniel J. Abadi, Stavros Harizopoulos, Nabil Hachem, and Pat Helland. In Proceedings of VLDB, 2007. (bibtex)


• Column Stores for Wide and Sparse Data
  Daniel J. Abadi. In Proceedings of CIDR, 2007. (bibtex)


• Materialization Strategies in a Column-Oriented DBMS
  Daniel J. Abadi, Daniel S. Myers, David J. DeWitt, and Samuel R. Madden. In Proceedings of ICDE, 2007. (bibtex)


• Performance Tradeoffs in Read-Optimized Databases
  Stavros Harizopoulos, Velen Liang, Daniel J. Abadi, and Samuel R. Madden. In Proceedings of VLDB, 2006. (bibtex)


• Integrating Compression and Execution in Column-Oriented Database Systems
  Daniel J. Abadi, Samuel R. Madden, and Miguel Ferreira. In Proceedings of SIGMOD, 2006. (bibtex)


• REED: Robust, Efficient Filtering and Event Detection in Sensor Networks
  Daniel J. Abadi, Samuel R. Madden, and Wolfgang Lindner. In Proceedings of VLDB, 2005. (bibtex)


• C-Store: A Column-Oriented DBMS
  Michael Stonebraker, Daniel J. Abadi, Adam Batkin, Xuedong Chen, Mitch Cherniack, Miguel Ferreira, Edmond Lau, Amerson Lin, Samuel R. Madden, Elizabeth J. O'Neil, Patrick E. O'Neil, Alexander Rasin, Nga Tran, and Stan B. Zdonik. In Proceedings of VLDB, 2005. 10 Year Best Paper Award (bibtex)


• The Design of the Borealis Stream Processing Engine
  Daniel J. Abadi, Yanif Ahmad, Magdalena Balazinska, Ugur Cetintemel, Mitch Cherniack, Jeong-Hyon Hwang, Wolfgang Lindner, Anurag S. Maskey, Alexander Rasin, Esther Ryvkina, Nesime Tatbul, Ying Xing, and Stan B. Zdonik. In Proceedings of CIDR, 2005. (bibtex)


• Aurora: A New Model and Architecture for Data Stream Management
  Daniel J. Abadi, Don Carney, Ugur Cetintemel, Mitch Cherniack, Christian Convey, Sangdon Lee, Michael Stonebraker, Nesime Tatbul, and Stan B. Zdonik. VLDB Journal, 12(2), September 2003. (bibtex)

Notable Blog Posts

• Data Fabric vs. Data Mesh: What's the Difference?
  Daniel J. Abadi. Starburst Blog. https://blog.starburst.io/data-fabric-vs.-data-mesh-whats-the-difference, 2021. (bibtex)


• Data Mesh: The Answer to the Data Warehouse Hypocrisy
  Daniel J. Abadi. Starburst Blog. https://blog.starburst.io/data-mesh-the-answer-to-the-data-warehouse-hypocrisy, 2021. (bibtex)


• Data Federation and Data Virtualization Never Worked in the Past But Now it's Different
  Daniel J. Abadi. Starburst Blog. https://blog.starburst.io/data-federation-and-data-virtualization-never-worked-in-the-past-but-now-its-different, 2021. (bibtex)


• Does the Data Mesh Make Data Integration Harder?
  Daniel J. Abadi. Starburst Blog. https://blog.starburst.io/does-the-data-mesh-make-data-integration-harder, 2021. (bibtex)


• An explanation of the difference between Isolation levels vs. Consistency levels
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2019/08/an-explanation-of-difference-between.html, 2019. (bibtex)


• Overview of Consistency Levels in Database Systems
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2019/07/overview-of-consistency-levels-in.html, 2019. (bibtex)


• The dangers of conditional consistency guarantees
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2019/07/the-dangers-of-conditional-consistency.html, 2019. (bibtex)


• Correctness Anomalies Under Serializable Isolation
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2019/06/correctness-anomalies-under.html, 2019. (bibtex)


• Introduction to Transaction Isolation Levels
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2019/05/introduction-to-transaction-isolation.html, 2019. (bibtex)


• Serializability vs "Strict" Serializability: The Dirty Secret of Database Isolation Levels
  Daniel J. Abadi and Matt Freels. Fauna Corporate Blog. https://fauna.com/blog/serializability-vs-strict-serializability-the-dirty-secret-of-database-isolation-levels, 2019. (bibtex)


• It's Time to Move on from Two Phase Commit
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2019/01/its-time-to-move-on-from-two-phase.html, 2019. (bibtex)


• Partitioned consensus and its impact on Spanner's latency
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2018/12/partitioned-consensus-and-its-impact-on.html, 2018. (bibtex)


• NewSQL database systems are failing to guarantee consistency, and I blame Spanner
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2018/09/newsql-database-systems-are-failing-to.html, 2018. (bibtex)


• An analysis of the strengths and weaknesses of Apache Arrow
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2018/03/an-analysis-of-strengths-and-weaknesses.html, 2018. (bibtex)


• Apache Arrow vs. Parquet and ORC: Do we really need a third Apache project for columnar data representation?
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2017/10/apache-arrow-vs-parquet-and-orc-do-we.html, 2017. (bibtex)


• Hazelcast and the Mythical PA/EC System
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2017/10/hazelcast-and-mythical-paec-system.html, 2017. (bibtex)


• Distributed consistency at scale: Spanner vs. Calvin
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2017/04/distributed-consistency-at-scale.html, 2017. (bibtex)


• Why MongoDB, Cassandra, HBase, DynamoDB, and Riak will only let you perform transactions on a single data item
  Daniel J. Abadi and Jose Faleiro. DBMS Musings. http://dbmsmusings.blogspot.com/2015/10/why-mongodb-cassandra-hbase-dynamodb_28.html, 2015. (bibtex)


• The problems with ACID, and how to fix them without going NoSQL
  Daniel J. Abadi and Alexander Thomson. DBMS Musings. http://dbmsmusings.blogspot.com/2010/08/problems-with-acid-and-how-to-fix-them.html, 2010. (bibtex)


• Problems with CAP, and Yahoo's little known NoSQL system
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2010/04/problems-with-cap-and-yahoos-little.html, 2010. (bibtex)


• Distinguishing Two Major Types of Column-Stores
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2010/03/distinguishing-two-major-types-of_29.html, 2010. (bibtex)


• A tour through hybrid column/row-oriented DBMS schemes
  Daniel J. Abadi. DBMS Musings. http://dbmsmusings.blogspot.com/2009/09/tour-through-hybrid-columnrow-oriented.html, 2009. (bibtex)

Tutorials and Panels

• Tutorial: SQL-on-Hadoop Systems
  Daniel J. Abadi, Shivnath Babu, Fatma Ozcan, and Ippokratis Pandis. Tutorial, VLDB, 2015. (bibtex)


• Panel: Are we experiencing a big data bubble?
  Fatma Ozcan, Nesime Tatbul, Daniel J. Abadi, Marcel Kornacker, C. Mohan, Karthik Ramasamy, and Janet L. Wiener. Panel Presentation, SIGMOD, 2014. (bibtex)


• Tutorial: Column oriented Database Systems
  Daniel J. Abadi, Peter A. Boncz, and Stavros Harizopoulos. Tutorial, VLDB, 2009. (bibtex)


• Panel: How best to build web-scale data managers?
  Philip A. Bernstein, Daniel J. Abadi, Michael J. Cafarella, Joseph M. Hellerstein, Donald Kossmann, and Samuel Madden. Panel Presentation, VLDB, 2009. (bibtex)

Demonstrations

• HadoopDB in Action: Building Real World Applications
  Azza Abouzied, Kamil Bajda-Pawlikowski, Jiewen Huang, Daniel J. Abadi, and Avi Silberschatz. Demonstration. SIGMOD, 2010. (bibtex)


• H-Store: A High-Performance, Distributed Main Memory Transaction Processing System
  Robert Kallman, Hideaki Kimura, Jonathan Natkins, Andrew Pavlo, Alex Rasin, Stan Zdonik, Evan Jones, Yang Zhang, Samuel Madden, Michael Stonebraker, John Hugg, and Daniel J. Abadi. Demonstration. VLDB, 2008. (bibtex)


• An Integration Framework for Sensor Networks and Data Stream Management Systems
  Daniel J. Abadi, Wolfgang Lindner, Samuel R. Madden, and Jorg Schuler. Demonstration. VLDB, 2004. (bibtex)


• Aurora: A Data Stream Management System
  Daniel J. Abadi, Don Carney, Ugur Cetintemel, Mitch Cherniack, Christian Convey, Christina Erwin, Eddie Galvez, Matt Hatoun, Jeong-Hyon Hwang, Anurag S. Maskey, Alexander Rasin, A. Singer, Michael Stonebraker, Nesime Tatbul, Ying Xing, R. Yan, and Stan B. Zdonik. Demonstration. SIGMOD, 2003. (bibtex)


• Visual COKO: A Debugger for Query Optimizer Development
  Daniel J. Abadi and Mitch Cherniack. Demonstration. SIGMOD, 2002. (bibtex)

Theses

• Phd Thesis: Query Execution in Column-Oriented Database Systems
  Daniel J. Abadi. MIT PhD Dissertation, 2008. SIGMOD Jim Gray Doctoral Dissertation Award (2008) (bibtex)


• M.Phil. Thesis: Comparing Domain-Specific and Non-Domain-Specific Anaphora Resolution Techniques
  Daniel J. Abadi. Cambridge University MPhil Dissertation, 2003. (bibtex)


• Undergraduate Senior Honors Thesis: Visual COKO: A Debugger for Query Optimizer Development
  Daniel J. Abadi. Brandeis University Senior Honors Thesis, 2002. (bibtex)