Wednesday, October 31, 2007

US ISV Developer Evangelism Team : Oslo-SOA & BPM

A roadmap into next year's MS offerings around SOA & BPM 

“Oslo” is the latest in a series of long term investments in SOA and BPM technologies, enabling the development of distributed applications. At the conference, we will disclose the targeted investment areas and the associated priorities. These product investments are part of a multi-release investment that will help advance the Dynamic IT initiative – specifically in the areas of ‘services-enabled’ and ‘model-driven’.

There are five primary areas of investment targeted by “Oslo” development efforts:

§ Framework: The .NET Framework “4” release will make further investments in model-driven development as part of our Windows Communication Foundation (WCF) and Workflow Foundation (WF) technologies. This will be the logical successor to the .NET Framework 3.5 release happening later this calendar year.

§ Server: This release will continue to evolve our BizTalk family of products as the distributed platform for highly scalable SOA and BPM solutions. BizTalk Server “6” will build deeply on top of both WCF and WF as its core foundation, and deliver the capability to develop, manage and deploy composite applications.

§ Services: Extending the early BizTalk Services incubation (currently available at labs.biztalk.net), the BizTalk Services “1” release will deliver a commercial release of hosted services that enable cross-organizational composite application scenarios. This includes expanded capabilities around hosted messaging, identity and workflow capabilities.

§ Tools: These investments will advance the application lifecycle management capabilities of Visual Studio Team System and provide support for an expanded range of roles. Furthermore, Visual Studio “10” will provide deep support for model-driven design and deployment of composite applications.

§ Repository: There will also be investments aligning the metadata repositories across the Server and Tools product sets. System Center “5”, Visual Studio “10” and BizTalk Server “6” will utilize a common repository technology for managing, versioning, and deploying models.

US ISV Developer Evangelism Team : Oslo-SOA & BPM

Microsoft Pushes Cloud Development

Tier-based development with Volta encourages developers to "use what's in the room"

The project to enable this is called Volta and it is headed up by Erik Meijer, a Microsoft architect in the company's SQL Server group. Meijer gave a demonstration of Volta at OOPSLA (Object-Oriented Programming, Languages, Systems and Applications) here on Oct. 23 and later discussed the technology with me.

Microsoft Pushes Cloud Development

More on Volta with Erik Meijer at Channel9.

Tuesday, October 23, 2007

SQL Community

MS has put up a web site dedicated to the SQL Server Community.. called the Microsoft SQL Server Community for Worldwide SQL Server Professionals.

http://www.sqlcommunity.com/

Looks like a bit of competition for www.SQLServerCentral.com

They're using DotNetNuke to power the site. I wonder why Sharepoint isn't up to snuff?

Monday, October 22, 2007

SimonS SQL Server Stuff : OCR for free from any image = PDF to Text

Yet another reason to use One Note... OCR from any image. 

OCR for free from any image

There are always features of products that you never now about. It is rare to go on training courses and so its up to you and your favourtie search engine to find out what a product does.

Onenote is a product I like. I'm not nuts about it but it is useful. One feature that I've always loved is the screen clipping feature. You always see users doing ALT+PRINT SCREEN to get a screen print, and then pasting into word and emailing 2Mb word documents with screen captures in them. The One Note feature allows you to not only select the section of the screen you want but also the file sizes aren't huge.

Its was my favourite feature until I found a new feature.

Image to Text.

Yes in Onenote you can copy the text from an image. I'm using it at the moment to convert screen captures I have from a terminal system to the text.

Simply this is OCR for free, out of the box. It also supports multiple languages.

To use the feature, paste an image into onenote, then select "Make Text in Image Searchable" and then select "Copy Text from Picture" and heh presto you have the text from the picture in the clipboard

SimonS SQL Server Stuff : OCR for free from any image

Wednesday, October 17, 2007

Microsoft SQL Server Development Customer Advisory Team

 

If a report does not use formatted cell values, query time can be reduced. An example is a Reporting Services report that does its own formatting and therefore would not use the formatted values from SSAS. By returning only the value of the cell and not its formatted value in MDX, you can achieve better queries performance, sometimes between 5-20%, depending on the size of the cell set. The default properties include FORMAT_STRING and FORMATTED_VALUE, and can be omitted by specifying a list of properties. An example is to add "cell properties VALUE" at the end of every query.

select [Measures].[Internet Sales Amount]

on columns

from [adventure works]

cell properties value

Microsoft SQL Server Development Customer Advisory Team

from Euan Garden's BLOG... SQL 2005 CTP

 Should have called it Q3 release but whatever...  Looks like they've integrated SQL Health and History tool and fixed Database Mirroring for starters.

SQL Server 2008 - July CTP Available

Nothing quite like cutting it fine on the naming still being valid :-)

Get all the info and downloads from here. A quick scan reveals the following improvements;

T-SQL - Separate Data and Time Types FINALLY, YIPEEEEEEEEEEEEEE

SQL Server 2008 introduces new date and time data types. The new data types enable applications to have separate date and time types, larger year ranges for date value, larger fractional seconds precision for time value, time-zone offset aware datetime type that containing date, time and time zone offset portion, user defined option on fractional seconds precision of time related types and datetime2 and datetimeoffset provide standards conformant semantics. Along with the T-SQL support on the new types, both native (ODBC, OLEDB) and managed (SqlClient) providers also provide the full support through the client driver APIs.

T-SQL - Object Dependencies

The object dependencies improvement provides reliable discovery of dependencies between objects through newly introduced catalog view and dynamic management functions. Dependency information is always up-to-date for both schema-bound and non-schema-bound objects. Dependencies are tracked for stored procedures, tables, views, functions, triggers, user-defined types, XML schema-collections, and more.

T-SQL - ORDPATH

ORDPATH improvement provides an important new functionality to our customers who use hierarchical data.  It provides a superior way of modeling hierarchies in SQL Server by introducing the HierarchyID system data type and corresponding built-in methods which are designed to make it easier to store, query and operate hierarchical data.  HierarchyID is also optimized for representing trees, the most common type of hierarchical data.

T-SQL - Large User Defined Types

Large user-defined types allows users to expand the size of defined data types by eliminating the 8‑KB limit.

Reporting Services - New Server and Designer

Improvements represent the two major infrastructure changes for Reporting Services. Reporting Services enhances the processing engine and rendering extensions to enable new functionality, such as Tablix support, and scalability as well as remove the dependency on IIS.  Additionally, new report designer and configuration tool are provided that improve usability and workflow for RS customers.

Management - Performance Data Collection

Collect data from various sources in SQL Server and OS to help with performance troubleshooting and server maintenance. With this improvement, organizations improve their analysis of common performance issues:

  • Define what data is collected and organize the collection into collection sets
  • Start/stop/manipulate collection sets programmatically (T-SQL and .NET API)
  • Define where data is stored (relational database)
  • View data through reports in SQL Server Management Studio.
  • Provide platform to plug in more data collectors in the future.

HADR - Database Mirroring Enhancements

SQL Server 2008 builds upon the momentum of SQL Server 2005 by providing a more reliable platform with enhanced database mirroring:

  • Automatic bad page repair - allows the principal and mirror machines to transparently recover from 823/824 types of data page errors by requesting a fresh copy of the corrupted page from the mirroring partner.
  • Log stream compression - compression of the outgoing log stream in order to minimize the network bandwidth used by database mirroring.
  • Miscellaneous performance enhancements:
    • Using asynchronous log write requests on the mirror in order to shorten the log write time and thus speed-up the commit acknowledgement.
    • Better utilization of the mirroring log send buffers in order to pack multiple smaller log blocks into a single network send.
  • Supportability and diagnosability improvements:
    • Additional performance counters to allow for more granular accounting of the time spent across the different stages of the DBM log processing.
    • New DMVs and extensions of existing views in order to expose additional information about the mirroring sessions.

Posted Tuesday, July 31, 2007 6:27 PM by euanga | 6 Comments

Filed under: SQL Server, Microsoft

Rosario: Next Generation of Team Test (almost) out in the wild - Rosario Aug CTP

Brian let the cat out of the bag earlier today, then Doug confirmed it. The project I came over to VSTS to focus on is starting to get shared. As Brian discusses in his post we demo'd live code from the Aug CTP and the CTP that will follow Aug this week to our Technical Field and it was very well received. Brian's right it has been pretty challenging for the team to be working on 2 full versions of VS at the same time(VS 2008 and Rosario) but I think the team have done a great job.

We'll start talking about the details of whats in the product over the coming weeks and months but I wanted to kick off my Rosario blogging by talking a little bit about the way that we think about testing and testers. Brian refers to Manual Tester in his blog but we really think of this as short hand for testers that do manual testing (the difference will become clear in a moment).

The testing that VSTT supports today is really in 3 forms;

  • Unit Testing, this is really a developer orientated form of testing and almost no "testers" use it directly but they wish all the developers in their team did!
  • Web Testing, this confused me when I first joined the team as I assumed it was UI testing for web apps, its not that and I like David Williamson's definition, its about using the browser to capture the (http)data required to test an http server, when we playback(or run the tests) we do so at the http level. Testing server protocols (even http) is a pretty technical and specialised task.
  • Load Testing, here we consume other tests and use them to simulate load against servers, web servers, reporting servers etc etc. We can use any test that includes code or web tests, this is somewhere that testers do/can use Unit Tests as they can form the basis of a load test. Again this is pretty technical and specialised testing.

When we decided to make a big investment in testing for VSTS going fwds (the team is more than 3x the size it was for VS 2005) one of the things we did was to segment the potential customer base into 3 broad buckets (with specialisations within, but we'll cover those in another post). Those buckets are;

  • The Developer Tester, this includes both TDD and traditional Unit Testing based developers who are focussed on using dev orientated testing to increase initial and ongoing code/application quality.
  • The Specialist Tester, this includes Load Testing, Security Testing, Protocol Testing, Very Deep/Complex Automation Testing etc etc, these are testers focussed on the more technical and specialised aspects of testing.
  • The Generalist Tester, these testers are about making sure the functional quality of the software is right for the user community, they might be former users of the software in question they likely do lots of manual testing, scenaro testing and some form of automation(but not all organisations do automation).

We want to provide a complete testing solution for customers, and that means have products/solutions for each one of these buckets(as well as managers, leads etc). As we start to reveal the layers of Rosario we'll come back to these roles and talk about the different pieces that we are building and how they address the requirements of each.

Posted Wednesday, July 25, 2007 5:11 PM by euanga | 2 Comments

Filed under: Microsoft, Team System, Testing, Rosario, VSTSR

Service Release of Data Dude now out

Gert has all the details.

Posted Wednesday, July 25, 2007 4:42 PM by euanga | 0 Comments

Filed under: SQL Server, Microsoft, Team System

Launch Date <> (or != if you prefer) RTM Date

At the World Wide Partner Conference (WWPC) this week Kevin Turner announced a launch date for the 2008 Wave of Products(Longhorn, Orcas and Katmai). There has been a lot of conjecture about products slipping and stuff like that.

To be clear this is all about a marketing launch, the RTM dates for these products are not the same as the launch date so you can draw almost no conclusions from that other than we are going to have lots of events and giveaways in Feb of next year :-)

For example when we launched VS2005, SQL2005 and Biztalk 2006 in Nov of 2005, SQL and VS had both been on MSDN for a number of weeks and Biztalk was still in Beta. When we launched Vista and Office 12 both had been available for a number of weeks before hand.

In the words of Cpl Jones "Don't panic Capt Mainwaring"

UPDATE: Doug (now in VSTS Marketing Yay!!!) says that VS will RTM before the launch, as he's in maketing he is allowed to say stuff like that, being in Prod Dev I'm not :-)

Posted Wednesday, July 11, 2007 2:21 PM by euanga | 8 Comments

Filed under: SQL Server, Microsoft, Team System

SQL Server Database Engine based Reporting and Analytics

(If you don't want to read the blurb just download

The SQL Team has had a long flirtation with building a Data Warehouse/Analytics system on top of the system information that exists in the Database Engine. The first time I remember discussing this was just after SQL 2000 shipped, we had mapped out all the SQL Agent jobs that needed to run, and what data to collect. The very first version of the product plan for Yukon had a Operations Data Warehouse feature listed but it got dropped pretty quickly as the scope of Yukon became clear.

Part of the reason it was an expensive feature in early days was the lack of consistent info in the server, we were going to have to use Trace, DBCC, System Tables, System Views and a bunch of undocumented stuff to accomplish a meaningful solution. However once DMVs started appearing in the product(that was not their original name) lots of ideas starting floating around again.

In parallel one of the small (I think there were 3 people that worked on the project) central test teams came up with the idea for H2( there was a predecessor but I don't remember its name and it was not broadly released, just select customers and internally) and built it, shipped it internally and then out to the public. There is interesting data in H2 but its mostly config data.

Through the personal perseverance of a couple of folks (mostly Dan Winn and Paul Mestamaker, then an intern, but others as well) with support from Dave Campbell we got a bunch of reports added to what was then the Summary View in Management Studio.

The Summary reports are great but they are more operational than they are analytical, lots of members of the community have filled in the gap by providing richer reports/analysis either plugged into SSMS or as standalone tools.

But as an analytics geek I have always wanted something more. Well last week the folks from the customer advisory team shipped out DMVStats which is a reporting and analytics solution focused on DMV reported perf data. I can't think of anyone better than these guys to ship such a tool as I am sure its based on real world usage. You can get it here.

Hopefully there is more to come in this space.

Posted Wednesday, July 04, 2007 10:23 PM by euanga | 3 Comments

Filed under: SQL Server, Microsoft

July SQL 2005 Best Practices Analyzer

This sneaked out, it does not say CTP so are we to presume this is a production version?

UPDATE: Paul says here that this is the final version (for now) and they are going to be doing ongoing updates to the rules, thats pretty cool.

Posted Tuesday, July 03, 2007 11:01 PM by euanga | 4 Comments

Filed under: SQL Server, Microsoft

More Posts Next page »

Euan Garden's BLOG

Top 10 SQL Server Blogs at Microsoft - SQLTeam.com

 

Written by Bill Graziano on 26 September 2007 | 3 Comments
Tagged with Developer Sites, DBA Sites

I read dozens of blogs every day related to SQL Server and development. I decided to try and list the Microsoft blogs where I find the most valuable content. Plus I included some non-blog SQL Server sites at Microsoft that I think you should know about.

Top 10 SQL Server Blogs at Microsoft - SQLTeam.com

SQL Server Forums - More fun with Katmai DUPSERT?

 An insert, delete and update in a single transaction?

-- Do the magic MERGE @Base AS b USING ( SELECT ID, SUM(Data) FROM @New GROUP BY ID ) AS src (ID, Data) ON src.ID = b.ID WHEN MATCHED AND src.Data = 0 THEN DELETE WHEN MATCHED THEN UPDATE SET b.data = src.Data WHEN NOT MATCHED THEN INSERT (ID, Data) VALUES (src.ID, src.Data); -- Last statement must end with a comma

SQL Server Forums - More fun with Katmai

SSMS Tools Pack: Main

 

SSMS Tools PACK is an Add-In (Add-On) for Microsoft SQL Server Management Studio and Microsoft SQL Server Management Studio Express.
It contains a few upgrades to the IDE that I thought were missing from Management Studio.
These are:


For now the SSMS Tools Pack is in its beta stage so please report any bugs on the contact page.
You can dowload it here.

SSMS Tools Pack: Main

Saturday, October 13, 2007

Donovan Lange's Work-Blog : Reasons you use OneNote?

 

My reasons are keeping a daily journal, screen shots for documentation, and research.  Here's plenty more.

  • OneNote allows me to put all of my little bits of information into a single place, organize them how I like, and always be able to find them instantly.
    • There’s a ton of information that doesn’t naturally have a good home otherwise.  Like the URLs I find when researching a topic, or the notes that I take during meetings.  Sure, I could use text files and notepad or post-it notes; but I’d have to create my own method for filing them into folders, navigate to the correct file to open them when I want to read them again, make sure I remember to hit Save (and give it a filename) before my laptop battery runs out and I lose my content, etc.  It really doesn’t scale when you have a lot of data.
  • It’s page surface allows me to outline, brainstorm, and collect rich forms of data better than any other tool out there.
    • Specifically, the ability to click anywhere on the page and just drag-drop any line of text to anywhere else on the page means that I can use this for random brainstorming and when writing out document outlines/drafts.  Things that don’t have linear or well-known structures. 
    • Plus, there’s a million features built into the application that allows me to embed non-textual forms of information.  So I can use screen clippings (via the Windows + S key) to take a picture of something currently on my screen, or embed a full document via the included OneNote Printer or the Insert Menu, and then annotate on top of that information.  And I can find it again, since we’ll OCR the text within the pictures.
    • Even without a tablet PC, the drawing shapes and click anywhere to type means that I can create simple diagrams without having to load up Visio.  With a tablet, I can draw directly on a page, and use a pen when I’m in a meeting where typing may be viewed as distracting.
    • It works with audio as well.  We record the audio for all of our spec reviews using the built-in laptop microphone.  Any notes typed during the meeting will be synchronized into the audio timeline for later review.  And OneNote will search the speech in the audio file as well.
  • It’s really good at capturing information quickly. 
    • Sometimes I need to get information written down as quickly as possible.  I don’t want to worry about making space in my word document, I can just click anywhere on the page and type. 
    • Ditto for inserting tables.  Just hit tab! 
    • I can launch a side-note window (which is a lot like a post-it note) from the system tray and grab down that phone number that someone just spouted off while I’m on the phone.
    • I can paste web content from a web page and it automatically includes the URL the content came from.  Huge time-saver.
    • I can apply metadata (flags) to my information or create Outlook Task items “in situ” along with the rest of the context that gives that task meaning.
    • I’m no longer restricted to keeping a single task list in Outlook.  When I’m in a meeting, or estimating a feature in OneNote I can tag a line as an Outlook Task, and it’ll create an Outlook Task for me, which is automatically kept in sync as I mark it completed, etc.  As a result, all of my ToDo items can live in the place where they’re most appropriate (like in the middle of my meeting notes, or in my shared notebook with you on a page of house projects) and yet have them rolled up appropriately in either OneNote or Outlook.
  • Outlook Integration, Outlook Integration, Outlook Integration.
    • In addition to task sync’ing, I find that there’s a ton of information that gets sent to me in email, which should live in OneNote instead.  (As email is more of a dynamic source of changing data, vs. an authored knowledge base.)  I can send an email to OneNote directly from Outlook 2007 via a single toolbar button click.  For someone who tries to keep their inbox nearly empty, being able to store messages like “how to access the internal newsgroups” (for instance) in a Notebook feels much cleaner than keeping them in my inbox.
    • In addition, I can also take notes about meetings (and have it find my previous meeting notes for a recurring meeting) or keep information about people from my Contact List / GAL in OneNote directly from the Outlook meeting and contact windows.  The link between the two stays present regardless of how that gets filed in my Notebooks.
  • My stuff is available everywhere.
    • I can’t emphasize how much this rocks.  My OneNote notebook is available at work, at home, on my phone (using OneNote mobile) and on my laptop.  All I did was point OneNote at a file share or Sharepoint Site, and OneNote takes care of the rest.  Plus, it synchronizes embedded documents as well, so I don’t have to use Sharepoint to upload a document or email it to myself.  I just drag-drop it right onto the OneNote page, and voila it’s everywhere I need it!  No sync’ing, no file locking, nothing.  It just works.
    • Moreover, it works when I’m offline.  Even those embedded documents… when I pick up my laptop and go to a conference room in another building, I can still keep typing, regardless of whether or not I’ve got wireless.  Go on vacation to the beach, and make changes to my notebook.  Whenever it comes online, it all merges back in without any user interaction.
  • It allows me to collaborate with others.
    • Word track-changes?  Sharepoint edit locks?  Yuck.  OneNote is a breeze by comparison.  Think of it like a Wiki on crack.  Everyone just opens up the same Notebook (or Section or page) and just types away.  It’s magic.
    • For those without OneNote, I can create PDFs of my pages, or send a page as an email with a single click.  The person on the other end of that email doesn’t even need OneNote to view my stuff.
  • I can store sensitive information and password protect it.
    • I generally use this for my personal notebook, but I find it invaluable to store my Credit Card numbers, Bank Account Information, Website Passwords, Frequent Flyer accounts, etc. all in a section that I then password protect.  Because the bits stored on disk are encrypted, I can access that file from a server and not worry about the security of the server, across the network, etc.
  • I can automate repetitive things.
    • I keep a work journal, and find that it’s really convenient to create a stationary (templates) page which is applied automatically to all new pages created in my Journal section.  It’s such a simple idea, but saves me a ton of time.
    • Not to mention all the cool add-ins that power-users have created that extends the functionality of OneNote. 
  • Source: Donovan Lange's Work-Blog : Reasons you use OneNote?

    Thursday, October 04, 2007