Conclusion and Future Work
5.2 Future Work
1. Automatic conversion from SQL query to functions can make the SQL administrator easy and feel like reports are displayed from the SQL.
2. Although simple replication is supported, Redis cluster is still on progress and we have not implement our approach in Redis cluster so that it can deal for big data as well through cloud computing.
3. Administrating the system so that it can deal with right data to right people.
5.3 Limitations
1. The time frame to capture the changed data should be very small as it is intended for real time. So, it is assumed that windows size will be small which captures less data for the operation.
2. It is not intended for batch processing and is not a replacement of ETL.
3. This is a module to address RTBI. It is made in plug and play approach and work together with existing ETL as described in Figure 3.1.
4. MBCFRTR is not for loading, processing and analyzing huge volumes of data, commonly referred to as big data.
5. Does not support traditional SQL queries and functions are written to get the report. So, those who are used to with sql query may feel difference while generating reports.
6. Various database administrator works and access control mechanism which is easy to maintain in RDBMS are not easy to maintain in MBCFRTR component.
Bibliography
[1] L. Wu, G. Barash, and C. Bartolini, “A service-oriented architecture for business intelligence,” in Proceedings of the IEEE International Con-ference on Service-Oriented Computing and Applications, SOCA ’07, (Washington, DC, USA), pp. 279–285, IEEE Computer Society, 2007. 1 [2] Z. Michalewicz and M. Michalewicz, Adaptive business intelligence /
Zbigniew Michalewicz ... [et al.]. Springer, Berlin :, 2007. 1, 10
[3] I. Ahmad, S. Azhar, and P. Lukauskis, “Development of a decision sup-port system using data warehousing to assist builders/developers in site selection,” Automation in Construction, vol. 13, no. 4, pp. 525 – 542, 2004. 4
[4] Cindi Howson, “Techno babble: Components of a business intelligence architecture.” http://www.b-eye-network.com/view/7105. Components of Business Intelligence Architectures, Mar. 2008. 4, 5, 9, 14
[5] Richard Hackathorn, “The bi watch:real-time to real-value.” DM Re-view, January. 2004. 5
[6] Z. Panian, “Just-in-time business intelligence and real-time decisioning,”
in Proceedings of the 9th WSEAS international conference on Applied informatics and communications, AIC’09, (Stevens Point, Wisconsin, USA), pp. 106–111, World Scientific and Engineering Academy and So-ciety (WSEAS), 2009. 5, 6, 10
Bibliography
[7] O. Corporation, “Real-time data integration for data warehousing and operational business intelligence.” Oracle White paper, August. 2010. 5, 31
[8] A. Simitsis, P. Vassiliadis, and T. Sellis, “Optimizing etl processes in data warehouses,” Data Engineering, International Conference on, vol. 0, pp. 564–575, 2005. 8
[9] P. V. et al., “Data provenance in etl scenarios.” University of Ioannina.
9
[10] B. Azvine, Z. Cui, D. D. Nauck, and B. Majeed, “Real time business intelligence for the adaptive enterprise,”E-Commerce Technology, IEEE International Conference on, and Enterprise Computing, E-Commerce, and E-Services, IEEE International Conference on, vol. 0, p. 29, 2006.
11, 25, 26, 27
[11] M. I. Hwang and H. Xul, “The effect of implementation factors on data warehousing success : An exploratory study,” Journal of Information, Information Technology, and Organizations, vol. 2, 2007. 13
[12] M. Golfarelli and S. Rizzi, “Designing the data warehouse: Key steps and crucial issues,”Journal of Computer Science and Information Man-agement, vol. 2, 1999. 14, 15
[13] I.-Y. Song and K. LeVan-Shultz, “Data warehouse design for e-commerce environments,” in Proceedings of the Workshops on Evolution and Change in Data Management, Reverse Engineering in Information Sys-tems, and the World Wide Web and Conceptual Modeling, ER ’99, (Lon-don, UK, UK), pp. 374–387, Springer-Verlag, 1999. 14
[14] M. Golfarelli, D. Maio, and S. Rizzi, “Conceptual design of data ware-houses from e/r schemes,” pp. 334–343, 1998. 14
[15] M. Golfarelli and S. Rizzi, “A methodological framework for data ware-house design,” in Proceedings of the 1st ACM international workshop
Bibliography
on Data warehousing and OLAP, DOLAP ’98, (New York, NY, USA), pp. 3–9, ACM, 1998. 14
[16] Microsoft, “Data Warehouse Design Considerations .”
http://msdn.microsoft.com/en-us/library/aa902672(v=sql.80).aspx, May. 2012. 14, 16
[17] T. Ariyachandra and H. Watson, “Key organizational factors in data warehouse architecture selection,” Decision Support Systems, vol. 49, pp. 200–212, May 2010. 17, 18, 19, 20, 21
[18] V. e. a. Lane, Pau;Schupmannl, Oracle9i Data Ware-housing Guide, Release 2 (9.2). Oracle Corporation, http://docs.oracle.com/cd/B10500_01/server.920/a96520/concept.htm, 2002. 19, 21
[19] D. A. Schneider, “Practical considerations for real-time business intelli-gence,” inProceedings of the 1st international conference on Business in-telligence for the real-time enterprises, BIRTE’06, (Berlin, Heidelberg), pp. 1–3, Springer-Verlag, 2007. 20, 21
[20] H. Watson and T. Ariyachandra, “Data warehouse architectures: Fac-tors in the selection decision and the success of the architectures,” tech.
rep., Terry College of Business, University of Georgia, July 2005. 21 [21] M. Golfarelli, S. Rizzi, and I. Cella, “Beyond data warehousing: what’s
next in business intelligence?,” in Proceedings of the 7th ACM interna-tional workshop on Data warehousing and OLAP, DOLAP ’04, (New York, NY, USA), pp. 1–6, ACM, 2004. 22, 23, 24, 25
[22] N. Stojanovic, L. Stojanovic, D. Anicic, J. Ma, S. Sen, and R. Stühmer,
“Semantic complex event reasoning—beyond complex event processing,”
inFoundations for the Web of Information and Services(D. Fensel, ed.), pp. 253–279, Springer Berlin Heidelberg, 2011. 27
Bibliography
[23] Team, The SQLstream, “Concepts in streaming sql, enabling real-time business intelligence and data integration.” www.SQLstream.com, 2009.
27, 28
[24] A. e. a. Arasu, “Stream: The stanford data stream management sys-tem.,” IEEE Data Engineering Bulletin, 26(1), 2003. 29
[25] Rodriguez, Jesus, “Real-time business
intel-ligence with microsoft sql server 2008 r2.”
http://channel9.msdn.com/Events/TechEd/NorthAmerica/2010/BIE403, June 2010. 30
[26] O. Corporation, “Best practice for real-time data warehousing.” Oracle Corporation, World Head Quaters 500 Oracle Parkway, 2010. 32, 33, 34 [27] J. Dean and S. Ghemawat, “Mapreduce: simplified data processing on
large clusters,” Commun. ACM, vol. 51, pp. 107–113, Jan. 2008. 35 [28] S. Edlich, “Nosql databases.” http://www.nosql-database.org, 2011. 35 [29] C. S. (cs134@hdm stuttgart.de), “Nosql databases.” 36
[30] amazon.com, “Amazon dynamodb.” http://aws.amazon.com/dynamodb/, 2012. 36
[31] G. e. a. DeCandia, “Dynamo: Amazon’s highly available key-value store.,” pp. 205–220, ACM, 2007. 36
[32] F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Bur-rows, T. Chandra, A. Fikes, and R. E. Gruber, “Bigtable: a distributed storage system for structured data,” in Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation - Volume 7, OSDI ’06, (Berkeley, CA, USA), pp. 15–15, USENIX Association, 2006. 36
[33] “Hbase.” http://hbase.apache.org/, 2012. 36, 70
Bibliography
[34] R. Ho, “Pragmatic programming techniques: Bigtable model with cassandra and hbase.” http://horicky.blogspot.com/2010/10/bigtable-model-with-cassandra-and-hbase.html, October. 2010. 37
[35] D. Kellogg, “What’s a column-oriented dbms?.”
http://kellblog.com/2007/03/31/whats-a-column-oriented-dbms/, March. 2007. 37
[36] R. Ho, “Bigtable model with cassandra and hbase | javalobby.”
http://java.dzone.com/news/bigtable-model-cassandra-and, December.
2010. 38
[37] “The apache cassandra project.” http://cassandra.apache.org/, 2012. 40 [38] P. Lakshman, A.;Malik, “Cassandra: a decentralized structured storage system,” vol. 44, pp. 35–40, ACM SIGOPS Operating Systems Review, 2010. 40
[39] DataStax, “Evolving hadoop into a low-latency data infrastructure.”
DataStax, www.datastax.com, 2011. 40, 41
[40] K. Weil, “Rainbird: Real-time analytics @twitter.”
http://assets.en.oreilly.com/1/event/55/Realtime Analytics at Twitter Presentation.pdf, 2011. 41, 42
[41] M. Bernard, “Sap high-performance analytic appliance 1.0 (sap hana),”
February. 2011. 43
[42] M. G. e. a. Vasu Murthy, “Oracle white paper – oracle exalytics in-memory machine: A brief introduction,” October. 2011. 43
[43] M. Bernard, “Memcached.” http://memcached.org/, 2011. 43 [44] Redis, “Redis.” http://redis.io, April. 2012. 43, 44
[45] T. Macedo and F. Oliveira., Redis Cookbook. O’REILLY, 2011. 44 [46] K. Seguin, The Little Redis Book. 44
Bibliography
[47] Jonathan Leibiusky, “Jedis.” https://github.com/xetorthio/jedis, April.
2012. 45