Setting up DevOps for a Startup on Day Zero

Scott Hanselman & I created our imaginary startup HanselJosh and the first thing we did was to get DevOps going on Day 0.  Here is your 15 mins look on how to get your DevOps rolling by creating a new team Project, a web site with SQL database backing it, setting up continuous integration from a Git repository, coding within Visual Studio using ASP.NET and then browsing the deployed code in the new Azure portal.

Areas covered in this video:

• Creating a new Team Project after choosing version control, process template, etc.
• Create a web site + SQL and configure it
• Create new database and configure it
• Open the repository in Visual Studio from the new Azure Portal
• Clone the repository using the Git integration in Visual Studio
• Create a new ASP.NET web site
• Set up continuous deployment/integration
• Commit and sync the project to Azure
• Browse the deployed code

Useful topics and links:

• The Azure Preview Portal – Tour and learn more about the Azure portal.

Related Videos:

• Overview of the new Azure Portal with Vishal Joshi
• Exploring the New Azure Portal

Video: Azure Resource Manager, Portal and more

Nathan & I got an opportunity to join Chris on Cloud Cover show to discuss how to make building cloud based apps easier using Azure resource manager, Visual Studio Online and Azure portal.  We also talked about dashboards, Resource Groups, Journeys, Continuous Deployment, Visual Studio Online integration, Analytics, Monitoring, Hosting Plans, Billing etc. Hope you find it useful!

Useful links from the show:

• The Azure Preview Portal
• Article on Hosting Plans

From the ground up: Building the Microsoft Azure Preview Portal

 

Brad Olenick and I had a chance to sync with Cory about how we built the new Microsoft Azure Preview Portal. During this show we dig into the reasoning behind the new portal, what it is build with under the covers and the design decisions made along the way. This show actually contains early mocks of the portal, some point in time screenshots and other fun exclusive content hope you will enjoy it.

Technologies Used

• ASP.NET Web API
• HTML
• LESS (CSS pre-processor) 
• TypeScript (JavaScript superset)
• Knockout
• D3.js
• RequireJS

Managing billing and saving money with the new Azure Portal

In this Azure Friday video, Scott Hanselman and I dig into the new Azure Portal and explore how best to save money and be aware of your bill and resources.
Areas covered in this video:

• Azure Portal
• Billing Hub
• Subscriptions
• Cost by resource
• Dashboard

Useful topics and posts:

• The Azure Preview Portal
• Introducing Web Hosting Plans for Azure Web Sites
• Visual Studio Online Integration in the Azure portal

Related Videos:

• Overview of the new Azure Portal with Vishal Joshi
• Exploring the New Azure Portal

Channel 9 Live: Enabling DevOps with Azure

Brian Keller chatted with Jonah & I on Channel 9 LIVE at the //build 2014 conference just after the launch of new Azure portal.  We chatted about several things about how the new design came about and also about funny things including failiens and HTTP 520 error, hope you will enjoy this.

Overview of new Azure portal

In this Azure Friday episode, I give a tour around the new Azure portal to Scott Hanselman.  We will talk about blades, hubs, journeys, lenses and more.

Areas covered in this video:

• Azure Portal
• Azure hubs, blades, lenses, journeys
• Customizing the Azure UI
• Azure console
• Azure templates

Useful topics and posts:

• The Azure Preview Portal
• Introducing Web Hosting Plans for Azure Web Sites
• Visual Studio Online Integration in the Azure portal

Related Videos:

• Exploring the New Azure Portal
• Enabling DevOps with Azure and Visual Studio Online

New Azure Portal – Trailer

For last year and half I have gone dark on my blog and it has been because of the secret project I have been working on.  Dreaming something crazy, forming the team, making something which is not attempted before, working with huge breadth of partners, simplifying complex scenarios to make it approachable by millions of customers, shipping it & finally users loving it is an awesome feeling which building the new Azure user experience has given everyone in my team. 
In some shape or form the goal was to re-imagine how cloud needs to be in the future and just before the release I spent sometime trying to build this 3 min video to give you a trailer of http://portal.azure.com.  You can also find it on http://azure.com Hope you enjoy it.

Continuous Deployment from GitHub to Windows Azure

On June 6^th we released Windows Azure Web Sites, which is a rock solid and scalable way to host your .NET, PHP or Node.js websites. You can deploy to Azure Web Sites using Git. You can learn about that and many other Windows Azure Web Site features in this introductory video that I recently did for our Windows Server 2012 launch event.
When you set-up Git publishing in Azure we create backend Git repo using our OSS project Kudu. You can then use this repos’ Git URL to happily git push azure master. Needless to say this option is still available to you. In addition, today we are taking the Git deployment features to the next level by enabling direct service integrations with CodePlex and Github.
Many customers have been asking that instead of having to push to azure directly every time, wouldn’t it be nice if you and your team could simply continue pushing to CodePlex/Github and then behind the scenes Azure could wake up and take the latest commits from your central source repo and update the site. Well, I am glad to let you know that this is feasible now.
In this post I am going to focus on showing you how to take your website source code hosted in Github and hook up deployment of the sources to Windows Azure in a continuous deployment fashion. I am hoping to make this into a guided step by step walkthrough with minimal expectation of pre-requisites so hopefully you can follow along and have a great experience along the way.
If you prefer video over a walkthrough then checkout Enabling Continuous Deployment with Windows Azure Websites and Github
To start you will need following 100% FREE pre-requisites.
Required
· You need to have an account on https://Github.com/
· You need to have Git on your machine. To get Git on your machine follow the instructions here
· You need to have a Windows Azure Account. If not then get one for free here!!
Recommended
· I will use node.js during the walkthrough but this will work even if you want to use PHP or ASP.NET. You can have a clean machine and we will do the required setups along the way.
· I will be using the free web development tool - WebMatrix, which will facilitate set-up of node.js if required. If you have not already, install WebMatrix 2 from here.
· I will be using SSH based push to Github. If you want to use SSH then learn how to generate & use SSH keys for Github. Alternatively, you can ignore SSH part and use HTTPS and still follow along the walkthrough below.
· Learn about Windows Azure Web Sites via video or article.
With pre-requisites behind us let us get started.

Step 1 – Find web site sources hosted on Github which you want to deploy to Azure

I am going to use the ExpressStarter site which Justin Beckwith on our team wrote. I just made a fork to the site for demo purposes.

Notice the highlighted “Fork” button, click it and you will get your own copy of the ExpressStarter template. Once you fork it you will get both SSH and HTTP end points to your git repo. My URL looks like below
HTTPS: https://Github.com/VishalRJoshi/ExpressStarter.git
SSH: git@Github.com:VishalRJoshi/ExpressStarter.git
I will be using these repo urls in the follow up steps:

Step 2 – Clone the Github repo locally on your machine

Open command prompt on your machine and navigate to a folder in which you would like to create the site. In my case I have navigated to C:\demos\GithubHooks. Now just type the command
git clone URL
Since I am using SSH my command is going look like below:
Once the clone is complete the command prompt should look like:

Step 3 – Make a quick change locally and push to Github

I am going to use WebMatrix for making the change especially because it supports bunch of node.js features. You can get WebMatrix 2 for free from http://webmatrix.com Note: WebMatrix is not supported on Mac so if you are on Mac please use any other text editor that you would like and skip the WebMatrix steps:
Once you open WebMatrix it should look like below:

Click “Open Site” à “Folder as Site” and navigate to the folder “ExpressStarter” under the directory where you ran the git clone command:

Hitting “Select Folder” will trigger WebMatrix to identify your site to be node.js site as below:
Hit “Continue” and you will be presented with a EULA screen like below.

Accept the EULA and at this point if you do not have node.js/npm/iisnode installed on your machine WebMatrix is going to install it for you. You should see a progress screen like below:

And once all the installation is complete you should be able to run you site locally by hitting the “Run” button in the WebMatrix ribbon.

If for any reason you see your browser saying something like below, please email me at vishal.joshi@microsoft.com or send a tweet @vishalrjoshi.

Ideally, you will not get the screen above and your running site should look as below:

Now, Let us now make a quick change. Click on the “Files” workspace at the left bottom corner of WebMatrix

Now expand the treeview to layout.jade and make the quick change from “Your logo here” to something like “My Awesome Github Site”

You can hit the run button and see the change locally on the new node.js site if you like. With that, we are ready to push this change back to Github. Let us go back to the command prompt
First change the directory to “ExpressStarter” as you will be one level above as shown below:

Next type the command git status. This will tell you what all files have been modified by you locally. Your git status command should show only one file changed

Now we want to commit this change to our local git repository. To do this we will type type the command git commit –am “My Awesome Github Site”

Now that our change is committed locally we are going to push the change up to Github. To do that we simply have to type git push origin master
Since I am using SSH keys I will not be asked for any password, but if you are using HTTPS then you might have to type your Github password at this point. Nevertheless the result should be as below:

If we now go and check the Commit history on my repo in Github it should show something like:

At this point you have a working local site with a local git repo. You have also remote central git repo in Github. You are also able to make changes locally and push them to Github. You can also authorize other developers in your team to this Github repository and they too can push their local changes to Github.
Our next goal here is to keep your workflow with Github exactly the same but in the process of pushing to Github we also want to be able to have the site up and running in Windows Azure. Do note so far we did not have Windows Azure in picture at all but now let’s set that up next.

Step 4 – Create a new site in Windows Azure

By now I assume you already have a free Azure account created, if not, create one here!! Once you have the account click on “Portal” button near top right of http://windowsazure.com
Now click on “+” icon on the bottom left of your Portal and you should get the below screen.
Select Compute à Web Site à Quick Create and name your site something unique. You can choose the region and subscription of your choice. If you are using the free trial subscription than that is what will be selected by default.
Now hit “Create Web Site” and wait for a few seconds. Your site should get running soon.

Step 5 – Enable Git Publishing for the new site

Next step is to enable “Git Publishing” for your new Azure site. To do that click on the site above to visit the dashboard and click “Setup Git Publishing”

This should show you some progress message and then land you on the below screen:

Open the flap which says “Deploy from my Github project” which should have the link “Authorize Windows Azure” as shown below:

Clicking the “Authorize Windows Azure” to your Github repository will launch a wizard which will set up service hook in Github. Let us follow the Wizard.

Step 6 – Follow the Wizard for hooking up your Github repo with your Azure site

First the Wizard will launch Github UI for you to log into. Just log-in with your Github credentials

On successful sign-in it will ask you to Authorize Windows Azure on Github like below:

Click “Allow”. Doing so will take you to the below screen stating “Authorization succeeded” and listing all the repos that you have access to in your Github account.

Select the ExpressStarter project that we have been checking into in Step 3 and click the “check” button. Within few seconds your Azure portal screen should show “Deployment progress” as below:

This is a moment to pause again and think what just happened. What Windows Azure did was to use the authorization that you gave via oAuth wizard to access Github API to first list your projects for you. Once you picked your project then it went and setup a service hook.
If you are really curious got to Github to your repository and click “Admin” as shown below

Then on the admin page you will see Service Hooks and Webhook Urls (1).
That URL is essentially the URL to your Azure Kudu Service which will be called by Github when there will be a push done on your Git repo within Github. As soon as Kudu Service receives a call from your Github account it wakes and pulls the latest commits from Github repo into the Azure repo. Currently we support only public repos to pull from but we are working on a solution to pull even from private Github repos over next few weeks.
Once Azure repo gets a commit the usual flow of Azure deployment triggers which includes fetching npm packages in case of node, doing build in case of ASP.NET etc. And you see the deployment progress that you see above.
Sometimes it might take time for the deployment progress to show, considering you now know what all happens behind the scene, please be patient, it will show up soon.

Step 7 – Check out your first auto deployment

Soon the deployment will be complete and you can see your first active deployment as shown below:

At the bottom of your Azure portal you will always see a black bar, which we call as command bar. It should have a browse button as shown below:

Click the “Browse” button and see your site launch live on Azure.

Hopefully you are happy as I am J well now let us go and make one more change to our local site.

Step 8 – Make another change locally and push back to Github

Go to WebMatrix and in the same layout.jade file make one more change. I am this time saying “My Awesome Azure Site” and hit “Save”

Rest of the deal is same as Step 3 above so I will avoid the repeat screenshots for most but the steps in command prompt essentially are:
git status
git commit –am “My Awesome Azure Site”
Now that the change it done it is time to see push the change to Github.

Step 9 – Check out your change go live on Azure

Just to see the awesome UI integration, I recommend you have your Azure portal side by side to your command window as you hit enter on the next command:
git push origin master

As soon as the git push completes you will see the Azure portal “Deployments” tab wake up and very soon you will have your second deployment

Now browse the site and notice that your second change has gone live as below:

Step 10 – Rollback to the first change with ease

For most part we are done but it is worth doing one last fun thing. Select the previous deployment and notice that in the command bar below you will have a “Redeploy” button as shown below:

Click that and you will be asked for a confirmation like:

Click “Yes” see the re-deploy kick in and notice that your “Active Deployment” changes within seconds

On browsing the site you will see that you are back to previous deployment

Conclusion

This is how easy it is to setup continuous deployments from Github to to Windows Azure. Almost the same type of workflow also works for CodePlex. If you have any questions of thoughts please do feel free to comment here or send me an email at vishal.joshi@microsoft.com. I will also continue posting updates on twitter @vishalrjoshi, hope you can join the conversation there too.
//code awesomely
Vishal

WebMatrix 2 is Released

On June 6th, I announced  RC version of WebMatrix 2.   I highly encourage you to read the post Announcing WebMatrix 2 RC as it covers most of the new features that we are releasing.

I also encourage you to visit www.webmatrix.com which has tons of user documentation.

Since the June RC release we primarily focused on getting polish on the product and as part of this post I am hoping to highlight the key changes since WebMatrix 2 RC.  This post is not intended to be flashy but hopefully will give you an understanding of the effort that the team took in taking WebMatrix 2 from RC to RTM.

In last few weeks we have worked to make WebMatrix 2 available in 14 languages below:

English	Italian	Czech
German	Korean	Polish
Japanese	Russian	Port-Brazil
French	Chinese-Simplified	Turkish
Spanish	Chinese-Traditional

The goal for the RTW release was not to add a ton of new features but to actually make only targeted changes to make your experience with the product even more awesome and raise the quality even more.  We had given “Go-Live” license with the RC release already but now hopefully there would be nothing stopping you upgrading from WebMatrix  1 to WebMatrix 2.  JFYI: we will soon turn on the “Upgrade” flag in WebMatrix which will prompt millions of users using WebMatrix 1 to move to WebMatrix 2.

WebMatrix 2 in my opinion is one of the best light weight web development tool out there.  With support for Node.js, PHP, ASP.NET, HTML5, CSS3, jQuery, SQL CE, SQL Server, MySQL, FTP, Web Deploy, Less, ScSS, Coffee Script, SEO, iPhone/iPad simulators and many many other features there is no doubt that it is probably the best web editing tool that one could possibly get for FREE, so if you are not already using it I hope you give it a try by downloading it below:

Since WebMatrix 2 RC we fixed over 100 bugs, many of them reported on Stackoverflow and user voice. Thanks for the taking the time to report issues, and helping us make WebMatrix 2 even better.  Below are some notable fixes that went in between WebMatrix 2 RC and RTM:

• Accessibility:  Microsoft has pretty high bar when it comes to accessibility and the team spent quite some time in making sure the product is highly accessible.
• Editor: Huge performance enhancements in editing of complex and big files.
• Editor: Better detection of JavaScript errors within script blocks of any html files.
• Editor: Formatting improvements on JavaScript Editor and enabling it to work more seamlessly with JSLint.
• Editor: Making sure that we show function signature help in JavaScript editor.
• Editor: Exposed extensibility points for Editor context menu.
• FTP: FTP publishing improvements including sub-folder publishing and re-tries in case of failures.
• Node.js: Code completion for Scoket.io for Node.js sites
• Node.js: Code outlining fix-ups for SaaS editor
• Node.js: Added a new template for package.json for Node.js sites
• PHP: Support for the new short PHP tag.
• PHP: Support for proper auto-completion for long PHP tags.
• PHP: Support for detection of PHP/MySQL Apps when downloaded from a remote location
• ASP.NET: Improved formatting of documents in ASP.NET Web Pages (Razor Syntax)
• ASP.NET: Making Comment/Un-comment work nicely across different types of syntax (CSS, JS, HTML, Razor) within ASP.NET Web Pages file.
• ASP.NET: Making C# colorization and intellisense more resilient in complex editing scenarios
• ASP.NET: Proper validation for generic types in C# & VB editors
• ASP.NET: Handling the nuances of Web Pages 1 vs. Web Pages 2 effectively
• General: Support opening a random folder as a site in WebMatrix by right clicking on it in Windows.
• General: Shipping RTW version of IIS Express, Web Pages, Web Deploy, SQL CE and every other component which makes WebMatrix 2 into a one stop shop for web development.
• General: Making sure the product works seamlessly on Windows XP and beyond, both on x86 and x64 machines.

With all these improvements we hope you will have fun using WebMatrix 2 and will create more awesome website in time to come.   Here is once again a link to the download.

/*code awesomely */

Vishal

PS: We now have few WebMatrix team twitter handles which you might want to consider following@vishalrjoshi @justinbeckwith & @webmatrix

Relook at top cities for technology startups

USA today released an article today on Top cities for technology startups.  It contains data from National Venture Capital Association.  It covered top 10 cities and gave a great writeup on what is happening in each place.  Their ranking was more or less based on amount of investment happening in each city and the usual suspects the winners as you can see.

I just thought of doing a little bit of hackery on top of the data to see how it would fair in case your parameters to select a city were different, here are quick results:

Top 10 cities based on most number of Startups

Rank	City
1	San Francisco Area
2	New York
3	Los Angeles Area
4	Boston
5	Chicago
6	Austin
7	Seattle
8	Boulder/Denver
9	San Diego
10	Washington DC

Top 10 cities based on most number of Funded Startups

Rank	City
1	San Francisco Area
2	New York
3	Boston
4	Washington DC
5	Los Angeles Area
6	Seattle
7	San Diego
8	Boulder/Denver
9	Chicago
10	Austin

Top 10 cities based on percentage of startups funded

Rank	City
1	Washington DC
2	Boston
3	San Diego
4	Seattle
5	Boulder/Denver
6	New York
7	Austin
8	Chicago
9	San Francisco Area
10	Los Angeles Area

Top 10 cities based on total dollars invested (Usa today ranking)

Rank	City
1	San Francisco Area
2	Boston
3	New York
4	Los Angeles Area
5	Washington DC
6	San Diego
7	Chicago
8	Austin
9	Boulder/Denver
10	Seattle

top 10 cities based on average funding across All startups

Rank	City
1	Boston
2	Washington DC
3	San Francisco Area
4	San Diego
5	Boulder/Denver
6	New York
7	Chicago
8	Los Angeles Area
9	Austin
10	Seattle

top 10 cities based on average funding across Funded startups

Rank	City
1	San Francisco Area
2	Los Angeles Area
3	San Diego
4	Boston
5	Chicago
6	Austin
7	New York
8	Boulder/Denver
9	Washington DC
10	Seattle

 

The data correctly it is slightly skewed based on big players and huge investments happening in them e.g. Twitter/Facebook etc but nevertheless it tells us a little bit about patterns.  The full comparison data is listed below:

Conclusion

This was not intended to be a conclusive article at all. It is just a fun exercise but in very broad strokes you can say something like:

• Your likelihood of getting funded is highest in Washington DC, Boston, San Diego, Seattle or Boulder/Denver.
• If you want to raise big money then you rather be anywhere in California or in Chicago or Boston.
• If you want to be cities filled with money then San Francisco, Boston, NYC, LA or DC are your best bets.

But based on all of the above diggings it feels like Boston might really be the all around champion of the study and if you are wanting to remain frugal yet immerse in startup scenes then DC, Seattle or Colorado might not be bad choices after Boston either!!

Hope this was a fun read!!  I also hang out on twitter @VishalRJoshi if you would like to follow.

-Vishal

Technorati Tags: Startups,Technology,Venture Capital,Cities