CS6750 Database Systems (Fall 2010)

CS6750: Database Systems (Fall 2010)

Tu & Th 3:30 pm, Thornton D221

Instructor: Sang H. Son

Email: son@virginia.edu

Text

Database Management Systems (3rd edition), Ramakrishnan and Gehrke, McGraw Hill, 2003.

Online Material: http://www.cs.wisc.edu/~dbbook

Backup Text

Fundamentals of Database Systems (5th edition), Elmasri and Navathe, Addison Wesley, 2007.

Objectives

To provide an introduction to basic issues of database systems, focusing on relational data models and database design. Query formulation and normal forms are two specific topics to be covered for relational model. Implementation issues including indexing, transactions, concurrency control, and recovery will be discussed. In addition, advanced topics including real-time databases and data services in sensor networks, will be discussed.

Grading

The course grade will be based on exams, quizzes, class discussion, paper presentation, and term project. The weights of exams and homeworks on the final grade will be

Exams, Quizzes, and Class Discussions 40%

Presentation 20%

Term Project 40%

Project

" Partial list of previous projects"
Project proposal due: Oct. 5

Examples of Project Proposals

" Data freshness and response time in Grids"

" Replica location services"

" Decentralized update management"

Examples of Project Final Reports

"1st example" A revised version was published at the IEEE Real-Time Systems Symposium, Miami, FL, Dec. 2005.

"2nd example" published at the 9th International Database Engineering and Applications Symposium (IDEAS'05), Monteal, Canada, July 2005.

"3rd example" - A revised version was published at the International Conference on Mobile Data Management, Hong Kong, 2001.

Papers

RTDB: Misconceptions and Survey

[RT1] J. Stankovic, S. H. Son, and J. Hansson, " Misconceptions About Real-Time Databases," IEEE Computer, vol. 32, no. 6, pp 29-36, June 1999.

[RT2] J. Haritsa and K. Ramamritham, " Real-Time Database Systems in the New Millenium," Real-Time Systems, vol. 19, no. 3, pp 205-208, Nov 2000.

[RT3] K. Ramamritham, S. H. Son, and L. DiPippo, " Real-Time Databases and Data Services," Real-Time Systems Journal, vol. 28, pp 179-216, Dec. 2004.

QoS in RTDB and Data Services

[RTQ1] K. Kang, S. H. Son, and J. Stankovic, " Managing Deadline Miss Ratio and Sensor Data Freshness in Real-Time Databases, " IEEE Transactions on Knowledge and Data Engineering, vol. 16, no. 10, October 2004.

[RTQ2] M. Amirijoo, J. Hansson, S. H. Son, and S. Gunnarsson, " Robust Quality Management for Differentiated Imprecise Data Services," 25th IEEE Real-Time Systems Symposium (RTSS'04), Lisbon, Portugal, Dec. 2004.

[RTQ3] Y. Wei, A. Aslinger, S. H. Son, and J. Stankovic, " ORDER: A Dynamic Replication Algorithm for Periodic Transactions in Distributed Real-Time Databases," International Conference on Real-Time/Embedded Computing Systems and Applications (RTCSA'04), Gothenburg, Sweden, Aug. 2004.

[RTQ4] Q. Han and N. Venkatasubramanian, " Adressing timeliness/accuracy/cost tradeoffs in information collection for dynamic environments," IEEE Real-Time System Symposium, Cancun, Mexico, Dec. 2003.

[RTQ5] Y. Wei, S. H. Son, and J. Stankovic, " Maintaining Data Freshness in Distributed Real-Time Databases," 16th Euromicro Conference on Real-Time Systems, Catania, Italy, June 2004.

[RTQ6] Y. Wei, S. H. Son, J. Stankovic, and K. Kang, " QoS Management in Distributed Real-Time Databases," 24th IEEE Real-Time Systems Symposium (RTSS'03), Cancun, Mexico, Dec. 2003.

[RTQ7] M. Amirijoo, J. Hansson, and S. H. Son, " Error-Driven QoS Management in Imprecise Real-Time Databases," 15th Euromicro Conference on Real-Time Systems, Porto, Portugal, July 2003.

[RTQ8] K. D. Kang, S. H. Son, J. A. Stankovic, "Differentiated Real-Time Data Services for E-Commerce Applications, Electronic Commerce Research,", Special Issue on Business Process Integration and E-Commerce Infrastructure, Kluwer Academic Publishers, vol. 3, no. 1-2, pp 113-142, January 2003.

[RTQ9] M. Amirijoo, J. Hansson, and S. H. Son, "Specification and Management of QoS in Real-Time Database Supporting Imprecise Computations," IEEE Transactions on Computers, vol.55, no. 3, March 2006.

[RTQ10] Y. Wei, V. Prasad, and S. H. Son, "Prediction-Based QoS Management for Real-Time Data Streams," IEEE Real-Time Systems Symposium (RTSS'06), Rio de Janeiro, Brazil, Dec. 2006.

[RTQ11] W. Kang, S. H. Son, J. Stankovic, and M. Amirijoo, " I/O-Aware Deadline Miss Ratio Management in Real-Time Embedded Databases, IEEE Real-Time Systems Symposium (RTSS'07), Tucson, AZ, Dec. 2007.

[RTQ12] K. Kang, J. Oh, and S. H. Son, " Chronos: Feedback Control of a Real Database System Performance, IEEE Real-Time Systems Symposium (RTSS'07), Tucson, AZ, Dec. 2007.

[RTQ13] W. Kang, S. H. Son, and J. Stankovic, " Power-Aware Data Buffer Cache Management in Real-Time Embedded Databases, IEEE Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA'07), Kaohsiung, Taiwan, Aug. 2008.

[RTQ14] W. Kang, S. H. Son, and J. Stankovic, " Design, Implementation, and Evaluation of a QoS-Aware Real-Time Embedded Database, IEEE Transactions on Computers, To appear.

RTDB: Scheduling, Consistency, Commitment, Recovery

[RT4] M. Xiong and K. Ramamritham, " Deriving Deadlines and Periods for Real-Time Update Transactions, " IEEE Trans. on Computers, vol. 53, no. 5, May 2004.

[RT5] M. Xiong, K. Ramamritham, J. Stankovic, D. Towsley, and R. Sivasankaran, " Scheduling Acess to Temporal Data in Real-Time Databases," IEEE Trans. on Knowledge and Data Engineering, vol. 14, no. 5, Sept. 2002.

[RT6] D. Nystrom, M. Nolin, A. Tesanovic, C. Norstrom, and J. Hansson, " Pessimistic concorrency control and versioning to support database pointers in real-time databases," Euromicro Conference on Real-Time Systems, June 2004.

[RT7] S. Gustavsson and S. Andler, " Decentralized and continuous consistency management in distributed real-time databases with multiple writers of replicated data," Workshop on parallel and distributed real-time systems, Denver, CO, April 2005.

[RT8] J. Haritsa, K. Ramamritham, and R. Gupta, " The PROMPT Real-Time Commit Protocol," IEEE Transactions on Parallel and Distributed Systems, pp. 160-181, vol. 11, no. 2, February 2000.

[RT9] L. Shu, J. Stankovic, and S. H. Son, " Achieveing Bounded and Predictable Recovery using Real-Time Logging," The Computer Journal, vol. 47, no. 3, pp 373-394, May 2004.

[RT10] A. Datta and S. H. Son, " A Study of Concurrency Control in Real-Time Active Database Systems," IEEE Transactions on Knowledge and Data Engineering, vol. 14, no. 3, pp 465-484, June 2002.

[RT11] M. Xiong, S. Han, and K. Lam, " A Deferrable Scheduling for Real-Time Transactions Maintaining Data Freshness," IEEE Real-Time Systems Symposium, Miami, FL, Dec. 2005.

[RT12] T. Gustafsson and J. Hansson, " Performance Evaluation and Estimations of Workload of On-Demand Updates in Soft Real-Time Systems," IEEE Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA), Dague, Korea, Aug. 2007.

Data Services in Sensor Networks

[SN0] Cougar Project " www.cs.cornell.edu/database/cougar"

[SN1] A. Demers et al, " The Cougar Project: A Work-in-Progress Report," ACM SIGMOD Record, vol. 34, no. 4, Dec. 2003.

[SN2] Y. Yao and J. Gehrke, " Query Processing in Sensor Networks," Conference on Innovative Data Systems Research (CIDR2003), Asilomar, CA, Jan. 2003.

[SN3] Q. Han, S. Mehrotra, and N. Venkatasubramanian, " Energy efficient data collection in distributed sensor environments," Int. Conference on Distributed Compyting Systems (ICDCS), Tokyo, Japan, March 2004.

[SN4] A. Somasundara et al, " Mobile Element Scheduling for Efficient Data Collection in Wireless Sensor Networks with Dynamic Deadlines," IEEE Real-Time Systems Symposium 2004, Lisbon, Portugal, Dec. 2004.

[SN5] N. Shrivastava et al, " Medians and Beyond: New Aggregation Techniques for Sensor Networks," ACM SenSys'04, Baltimore, MD, 2004.

[SN6] J. Hellerstein et al, " Beyond Average: Towards Sophisticated Sensing with Queries," Information Processing in Sensor Networks (IPSN), 2003.

[SN7] S. Nath et al, " Synopsis Diffusion for Robust Aggregation in Sensor Networks," ACM SenSys'04, Baltimore, MD, 2004.

[SN8] I. Lazaridis and S. Mehrotra, " Capturing sensor generated time series with quality guarantees," IEEE Int. Conference on Data Engineering, 2003.

[SN9] U. Cetintemel, A. Flinders, and Y. Sun, " Power-Efficient Data Dissemination in Wireless Sensor Networks," ACM MobiDE'03, San Diego, CA, 2003.

[SN10] T. Abdelzaher et al, " Envirotrack: Towards an Environmental Computing Paradigm for Distributed Sensor Networks," International Conference on Distributed Computing Systems (ICDCS'04), Tokyo, Japan, March 2004.

[SN11] T. He et al, " An Energy-Efficient Surveillance System Using Wireless Sensor Networks," MobiSys'04, Boston, MA, June 2004.

[SN12] S. Li, S. Son, and J. Stankovic, " Event Detection Services Using Data Service Middleware in Distributed Sensor Networks," Telecommunication Systems, Special Issue on Information Processing in Sensor Networks, vol. 26, no. 2-4, pp 351-368, Aug. 2004.

[SN13] D. Abadi, S. Madden, and W. Lindner, " REED: Robust Efficient Filtering and Event Detection in Sensor Networks," VLDB, Norway 2005.

[SN14] S. Ratnasamy, D. Estrin, R. Govindan, B. Karp, S. Shenker, L. Yin, and F. Yu, " Data-Centric Storage in Sensornets," Workshop on Sensor Networks and Application, Atlanta, GA, Sept. 2002.

[SN15] D. Ganesan, et al., " An Evaluation of Multi-Resolution Storage for Sensor Networks," SenSys'03, LA, CA, Nov. 2003.

[SN16] C. Intanagonwiwat, D. Estrin, R. Govindan, J. Heidemann, " Impact of Network Density on Data Aggregation in Wireless Sensor Networks," ICDCS, Vienna, Austria, July 2002.

[SN17] S. Bhattacharya, H. Kim, S. Prabh, and T. Abdelzaher, " Energy-Conserving Data Placement and Asynchronous Multicast in Wireless Sensor Networks," MobiSys, San Francisco, CA, May 2003.

[SN18] H. Kim, T. Abdelzaher, and W. Kwon, " Minimum Energy Asynchronous Dissemination to Mobile Sinks in WSN," SenSys'03, LA, CA, Nov. 2003.

[SN19] X. Li, Y. Kim, R. Govindran, and W. Hong, " Multi-dimensional Range Queries in Sensor Networks," SenSys'03, LA, CA, Nov. 2003.

[SN20] R. Kumar, et al., " DFuse: A Framework for Distributed Data Fusion," SenSys'03, LA, CA, Nov. 2003.

[SN21] B. Przydatek, D. Song, and A. Perrig, " SIA: Secure Information Aggregation in Sensor Networks," SenSys'03, LA, CA, Nov. 2003.

[SN22] S. Madden, M. Franklin, J. Hellerstein, and W. Hong, " The Design of an Acquisitional Query Processor for Sensor Networks," ACM SIGMOD Conference, San Diego, CA, June 2003.

[SN23] Fan Ye, Haiyun Luo, Jerry Cheng, Songwu Lu, Lixia Zhang, " A Two-tier Data Dissemination Model for Large-scale Wireless Sensor Networks", MobiCom 2002.

[SN24] J. Gao, L. Guibas, and J. Hershberger, " Sparse Data Aggregation in Sensor Networks," IPSN, Cambridge, Massachusetts, 2007.

[SN25] S. Madden, M. Franklin, J. Hellerstein, W. Hong, " TAG: A Tiny Aggregation Service for ad hoc Sensor Networks," OSDI Conf., Boston, December 2002.

[SN26] L. Ying, Z. Liu, D. Towsley, C. Xia, " Distriubuted Operator Placement and Data Caching in Large-Scale Sensor Networks," IEEE Infocom 2008.

[SN27] A. Deshpande, C. Guestrin, S. Madden, J. Hellerstein, W. Hong, " Model-Driven Data Acquision in Sensor Networks," VLDB 2004, Toronto, Canada, 2004.

[SN28] X. Liu, Q. Huang, and Y. Zhang, " Combs, Needles, Haystacks: Balancing Push and Pull for Discovery in Large WSNs," Sensys 2004, Baltimore, MD, 2004.

[SN29] S. Krishnamurthy, T. He, G. Zhou, J. Stankovic, and S. H. Son, " RESTORE: A Real-Time Event Correlation and Storage Service for Sensor Networks," International Conference on Networked Sensing Systems (INSS'06), Chicago, June 2006.

[SN30] M. Amirijoo, S. H. Son, and J. Hansson, " QoD Adaptation for Achieving Lifetime Predictability of WSN Nodes Communicating over Satellite Links," International Conference on Networked Sensing Systems (INSS'07), Braunschweig, Germany, June 2007.

[SN31] W. Liang and Y. Liu, " Online Data Gathering for Maximizing Network Lifetime in Sensor Networks," IEEE Trans. on Mobile Computing, vol. 6, no. 1, Jan. 2007.

[SN32] D. Tulone and S. Madden, " PAQ: Time Series Forecasting for Approximate Query Answering in Sensor Networks," European Wireless Sensor Networks Conference, 2006

[SN33] S. Pleisch and K. Birman, " SENSTRAC: Scalable Query of Sensor Networks from Mobile Platforms using Tracking-style Queries," MASS, 2006

[SN34] O. Chipara, C. Lu, and G. Roman, " Real-Time Query Scheduling for Wireless Sensor Networks," IEEE RTSS, Dec. 2007.

[SN35] J. Xu, X. Tang, and W. Lee, " A New Storage Scheme for Approximate Location Queries in Object Tracking Sensor Networks," IEEE Trans. on Parallel and Distributed Systems, vol. 12, no. 2, Feb 2008.

[SN36] Y. Zhang, B. Hull, H. Balakrishnan, and S. Madden, " ICEDB: Intermittently-Connected Continuous Query Processing," IEEE Conference on Data Engineering, 2007

[SN37] P. Desnoyers, D. Ganesan, P. Shenoy, " TSAR: A Two-Tier Sensor Storage Architecture using Interval Skip Graphs," SenSys, San Diego, Nov 2005.

[SN38] X. Yang et al., " In-Network Execution of Monitoring Queries in Sensor Networks," ACM SIGMOD, Beijing, China, June 2007.

Dynamic Data Dissemination in Web Applications

[DD1] S. Agrawal, K. Ramamritham, and S. Shah, " Construction of a Coherency Preserving Dynamic Data Dissemination Network," IEEE Real-Time Systems Symposium 2004, Lisbon, Portugal, Dec. 2004.

[DD2] S. Shah, K. Ramamritham, and P. Shenoy, " Resilient and Coherence Preserving Dissemination of Dynamic Data using Cooperating Peers," IEEE TKDE, vol. 16, no. 7, July 2004.

[DD3] S. Pandey, K. Ramamritham, and S. Chakrabarti, " Monitoring the Dynamic Web to Respond to Continuous Queries," WWW 2003, Budapest, Hungary, May 2003.

[DD4] M. Bhide et al., " Adaptive push-pull: disseminating dynamic web data," IEEE Transactions on Computers, vol. 51, no. 6, June 2002.

[DD5] R. Majumdar, K. Moudgalya, and K. Ramamritham, " Adaptive cohenrency maintenance techniques for time-varying data," IEEE Real-Time Systems Symposium 2003, Cancun. Mexico, Dec. 2003.

Databases for Automobile Control

[RTA1] T. Gustafsson and J. Hansson, " Data management in real-time systems: A case of on-demand updates in vehicle control systems," IEEE RTAS'04, Toronto, Canada, May 2004.

[RTA2] T. Gustafsson and J. Hansson, " A Similarity-Aware Multiversion Concurrency Control and Updating Algorithm for Up-to-Date Sanpshots of Data," Euromicro International Conference on Real-Time Systems, Spain, June 2005.

[RTA3] D. Nystrom, A. Tesanovic, M. Nolin, C. Norstrom, and J. Hansson, " COMET: A component-based real-time database for automotive systems," ICSE Workshop on Software Engineering for Automotive Systems, May 2004.

[RTA4] D. Nystrom, A. Tesanovic, C. Norstrom, J. Hansson, and N. Bankestad, " Data Management Issues in Vehicle Control Systems: a Case Study," 14th Euromicro International Conference on Real-Time Systems, Vienna, Austria, June 2002.

[RTA5] T. Gustafsson and J. Hansson, " Performance Evaluations and Estimations of Workload of On-Demand Updates in Soft Real-Time Systems," Euromicro International Conference on Real-Time Systems, Spain, June 2005.

New Approaches of Data Systems and Services

[NAD1] S. Lee, et al., " A Case for Flash memory SSD in Enterprise Database Applications," ACM SIGMOD, Vancouver, Canada, 2008.

[NAD2] A. Lakshman and P. Malik, " Cassandra - A Decentralized Structured Storage System," ACM Workshop on Large-Scale Distributed Systems and Middleware, Big Sky, Montata, 2009.

[NAD3] S. Philippi, " Model Driven Generation and Testing of Object Relational Mappings," Journal of Systems and Software, 2005.

[NAD4] P. Liu and S. Jajodia, " Multi-Phase Damage Confinement in Database Systems for Intrusion Tolerance," IEEE workshop on Computer Security Foundations, 2001.

[NAD5] N. Zhang and W. Zhao, " Privacy Protection against Malicious Adversaries in Distributed Information Sharing Systems," IEEE Trans. on Knowledge and Data Engineering, Aug 2008.

[NAD6] F. Chang et al., " Bigtable: A Distributed Storage System for Structured Data," 7th USENIX Sympsium on Operating Systems Design and Implementation (OSDI), Seattle, Washington, Nov. 2006.

Mobile Data Services

[RTM1] S. Ilarri et al, " Location-Dependent Queries in Mobile Contexts: Distributed Processing using Mobile Agents," IEEE Trans. on Mobile Computing, vol. 5, no. 8, Aug 2006.

[RTM2] B. Gedik, K. Wu, P. Yu, and L. Liu, " Processing Moving Queries over Moving Objects using Motion-Adaptive Indexes," IEEE Trans. on Data and Knowledge Engineering, vol. 18, no. 5, May 2006.

Stream Data Management

[SD0] Lukasz Golab and M. T. Ozsu, " Issues in data stream management," ACM SIGMOD Record, June, 2003.

[SD1] D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, G. Seidman, M. Stonebraker, N. Tatbul, and S. Zdonik, " Monitoring Streams: A New Class of Data Management Applications," VLDB02, Hong Kong, China, August 2002.

[SD2] Abhinandan Das, Johannes Gehrke and Mirek Riedewald, " Approximate join processing over data streams," ACM SIGMOD 2003, June, 2003.

[SD3] D. Carney, U. Cetintemel, A. Rasin, S. Zdonik, M. Cherniack, M. Stonebraker, " Operator Scheduling in a Data Stream Manager," International Conference on Very Large Data Bases (VLDB'03), Berlin, Germany, September 2003.

[SD4] B. Babcock, S. Babu, M. Datar, R. Motwani, and D. Thomas, " Operator Scheduling in Data Stream Systems," VLDB Journal, Special Issue on Data Stream Processing, to appear.

[SD5] B. Babcock, M. Datar, and R. Motwani, " Load Shedding for Aggregation Queries over Data Streams," Proc. of Intl. Conference on Data Engineering (ICDE 2004), March 2004.

[SD6] N. Tatbul, U. Cetintemel, S. Zdonik, M. Cherniack, M. Stonebraker, " Load Shedding in a Data Stream Manager," International Conference on Very Large Data Bases (VLDB'03), Berlin, Germany, September 2003.

[SD7] C. Olston, J. Jiang, and J. Widom, " Adaptive Filters for Continuous Queries over Distributed Data Stream," ACM Intl Conf. on Management of Data (SIGMOD 2003), June 2003.

[SD8] Y. Wei, S. H. Son, and J. Stankovic, " RTStream: Real-Time Query Processing for Data Streams," IEEE Symposium on Object-Oriented Real-Time Distributed Computing (ISORC'06), Gyeongju, Korea, April 2006.

[SD9] Y. Wei, S. H. Son, and J. Stankovic, " Prediction-Based QoS Management for Real-Time Data Streams," 27th IEEE Real-Time Systems Symposium (RTSS'06), Rio de Janeiro, Brazil, Dec. 2006.