Is there any open source software that allows you to export data from tables of (any type of) database to SQL statements?
I know that SQL server's management studio has this as built-in function, and TOAD for Oracle. I was wondering if there are any "generic" software that can do that for a variety of databases, much like the ETL tools (e.g. Talend Open studio)
Related
I am a software developer that is new to the Power BI world. I have inherited a project that is making use of Power BI Desktop as a reporting platform to leverage the ability to generate ad hoc reports, including graphics.
We are using SqlServer 2016 as the data source. The data utilized for the reports is stored in the database as xml text. The xml is provided by a vendor and stored in the database. We want to read the xml from the database into XMLDATA, then decompose that into data tables (30+ tables) using queries. The XMLDATA data table is set to DirectQuery storage mode. All of the decomposed tables are set to Import storage mode with the query source set to XMLDATA.
When a refresh is done, each of the decomposed data table's data is being imported, which is taking a long time (2+ hours for 17500 xml records, and this is a small test set of records). It seems as though Power BI Desktop is reading all of the database rows for each of the tables instead of using the XMLDATA read in from the database. Is there a way to set up the decomposed tables so they use the XMLDATA instead of importing for each table? We are only using Power BI Desktop and none of the other Power BI products/services.
Does JOOQ support dialect for "SQL DataWarehouse"?
Any pointers .
From a jOOQ perspective, SQL Data Warehouse is just another flavour of SQL Server as can be seen in the documentation:
https://learn.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-reference-tsql-statements
Like SQL Server, SQL Data Warehouse implements parts of the T-SQL language
I question why you're planning to use a Java-focussed query generator with an MPP data warehouse. If you're intending to use it for updates, deletes, etc. in some kind of ETL flow, you're going to be in a world of pain.
Nothing wrong with JOOQ, but maybe not the right technology for interacting with ASDW.
What the differences between "Cognos TM1" and "Cognos 10 BI"?
Which one is consider as BI Tools by IBM?
There are huge differences between "Cognos TM1" & "Cognos 10 BI"!
Cognos TM1 is a (OLAP) multidimensional database which can be queried from Excel and the Web through "TM1 Web", "TM1 Executive Viewer" and "Cognos 10 BI". Within this database, you'll be able to create almost anykind of OLAP / Decisional application.
Cognos 10 BI is a web based reporting application. Users, depending on their rights (licence) will be able to run reports, schedule reports and/or create ad hoc analysis against relational and/or multidimensional databases. In order to do so, a logical layer has to be built using "Framework Manager". This logical layer is used to hide database complexity and to provide to the end users relevant information.
In simplest terms:
TM1 is a database engine and a collection of applications for accessing and managing its databases.
Cognos BI is a collection of web applications that provide pretty interfaces for viewing and doing stuff with data.
More often than not, Cognos BI uses TM1 databases as its data source, but it does not have to. If Cognos BI is using TM1, most of the same user functions that are possible in TM1 applications are also available through Cognos BI, except they are available in a more user-friendly manner. Cognos BI also adds functionality not in TM1 applications to allow additional data management. IBM's marketing is confusing, but generally Cognos BI and Cognos TM1 collectively are considered to be the BI Tools package that they offer.
Now to be a little more technical about TM1, it is not just a plain old database. As others here have mentioned, it is a multidimensional OLAP database. It is able to handle numeric and string data, but it does not have a concept of NULL values. Numeric data can be summarized using consolidated elements. It has attributes to store metadata in. It has a built-in rules engine to handle business logic and custom calculations. It has processes for ETL and database maintenance tasks. It has chores for scheduling processes at various intervals. It links to Excel workbooks. Lastly, in addition to these features and more that are provided out of the box, TM1 exposes an API for programming against using 3GLs such as C++, C#, Java, and even VBA.
The key difference is Cognos TM1 is meant to work with excel easily wheras Cognos 10 BI is mainly browser based.
Have a look here for gory details.
http://www.tm1forum.com/viewtopic.php?f=5&t=1442
Cognos TM1 is also referred to by IBM as Financial Performance Management FPM. It's an in-memory MOLAP cube application with real-time rules calculation. As it provides end-user writeback it's often used by the Office of Finance for budgeting and modelling - therefore the MS Excel interface is frequently used. However it also comes with a zero footprint web "front end" as well as Cognos Insight, which permits distributed or disconnected access to the TM1 cubes (located server side).
TM1 may be integrated into Cognos BI, so that Cognos BI reports from TM1 cubes; or TM1 may be accessed from a portlet within a Cognos BI dashboard.
difference between cognos10 and cognos tm1 :-BI is the reporting tool and cognos tm1 is analysis and reporting tool , in tm1 bulid the CUBES and BI generatead the reports
I am new to Sybase and having coded in Oracle server for so many years I wanted to pack some reusable code into a function in Sybase ASE 15.
Based on what I have found, functions or User Defined Functions (UDFs) as they called in the Sybase world is a new feature in Sybase 15 ASE. I use Embarcadero Rapid SQL 7.7 for my coding and it does not even seem to have a node for Functions (as it does for Procedures and other database objects under a database tree).
I am able to create a simple function but it does not show-up anywhere in the left hand side organizer panel of Rapid SQL. Am I missing something basic as I am new to Rapid SQL or the tool - Rapid SQL, in its current version 7.7- is not designed to support functions in Sybase as functions are new to Sybase?
Though Sybase ASE 15 supports functions if it is not visible in the tool I do not want to use it as it makes it harder for maintenance. Is Rapid SQL planning to support UDFs in Sybase in the future?
Is there a work around for using a stored procedure as a function in Sybase ASE 15?
I recommend you to use Sybase Central.
With that, check the Functions Folder under the Database and they will be there!
Rapid SQL 8.0 does indeed have support for UDF's. Visit the enbarcadero site to download the 8.0.2 version of Rapid SQL. Shoot me an email if you have any issues getting it. scott.walz#embarcadero.com
Good afternoon,
Anyone know if sql express 2008 version, the option of using TDE (Transparent Data Encryption).
I tried using it for testing and the server gave me the following error.
"The transparent data encryption is not available in the publication of this instance of SQL Server. See Books Online for more details on feature support in different editions of SQL Server."
Thanks and a greeting.
TDE is available only in Enterprise editions AFAIK.
As mentioned, Microsoft supports TDE only in Enterprise Edition. However, there are several third party products that will provide TDE to all editions and verions of SQL Server, including SQL Express. One of those products being ours: Encryptionizer for SQL Server. Another one that I am aware of is DBDefence. Internally they work very differently though: Encryptionizer sits between SQL Server and the Operating System, while DBDefence injects itself into the SQL process running in memory to change the behavior of the process.