TheSaffaGeek

My ramblings about all things technical


Leave a comment

Blog Sponsor – Pluralsight

I am pleased to announce the second sponsor of my blog: Pluralsight . I am really excited by this sponsorship as I have been a massive fan and user of Pluralsight’s and previously Trainsignal’s videos and online courses for years and they  have helped me pass all of my certifications within the last 7 years so you can understand how fond of the courses I am.

Pluralsight

Pluralsight’s purchase of Trainsignal has enabled the videos to now be available via your tablet and gives you the ability to download videos to your tablet so you can watch them without needing Wi-Fi like on a train or plane. I honestly can’t recommend them enough and would highly recommend you give them a try and sign up for their no obligation 10-day free trial. They have videos ranging from VMware technologies, learning programming languages from scratch or advanced courses , Windows technologies,hacking, A+ N+ , leadership courses and Scrum fundamentals to name but a fraction of the courses. For some of the certifications I have recommended and personally used Pluralsight courses for and will be using again in the future have a look at the following study resources pages and blog posting:

http://thesaffageek.co.uk/vsphere-5-study-resources/vcp5/

http://thesaffageek.co.uk/vsphere-5-study-resources/vcap5-dca-dcd/

http://thesaffageek.co.uk/vsphere-5-x-cloud-study-resources/vcp5-iaas-and-vcp5-cloud/

http://thesaffageek.co.uk/vsphere-5-x-cloud-study-resources/vcap5-cia-and-cid/

http://thesaffageek.co.uk/2014/04/28/vcdx-prep-round-2/

 

Gregg


Leave a comment

VMworld Day 2

VMworld EMEA day 2 kicked off with the keynote from Carl Echenbach, Ben Fathi and Raghu Raghuram. Unfortunately the keynote was again largely a repeat of the VMworld US day 2 one with all of the same jokes and mock up pictures also. Due to this I’m not going to break down the keynote but rather recommend you watch the keynote recording here.

After watching the keynote and writing up my VMworld Day 1 blog posting I helped the vBrownbag crew with preparations for the TechTalks for which the recordings are now available on the vBrownbag YouTube channel. I would highly recommend watching these as there were some really great presentations from some very big vendors and names within the industry. I then went to the hands on labs and did  HOL-SDC-1420 – OpenStack with VMware vSphere and NSX. The lab was really good and I plan to do the second part of it today.

Talking about containers VMware released a blog posting yesterday around Docker containers performance in VMware vSphere. some of the highlights from the article are that:

  • VMware find that for most of these micro-benchmarks and Redis tests, vSphere delivered near-native performance with generally less than 5% overhead.
  • Running an application in a Docker container in a vSphere VM has very similar overhead of running containers on a native OS (directly on a physical server).

To view the full blog post, you can visit :  http://blogs.vmware.com/performance/2014/10/docker-containers-performance-vmware-vsphere.html

After the HOL I attended the Solutions exchange and spoke to some of the vendors whose solutions interest me such as Nutanix, Hitachi Data Systems, PernixData, Simplivity , SolidFire and Colt stalls. Some amazing solution from these guys as well as many others, it’s scary how much the virtualisation ecosystem is changing.

From the solutions exchange I attended session STO2997-SPO The vExpert Storage Game Show EMEA which was really good fun and filled by really smart guys on the stage. I watched the recording of the one from the US a few weeks ago and it too was very informative and is a session I would recommend watching from both VMworld’s.

I then made my way back to the solutions exchange for the hall crawl where Hitachi were serving up sake and sushi at their stand which is two of my favourite things so I had to make sure I got myself some and they even gave us nice sake cups which I will personally use for a double espresso cup. A big thanks to Paul Meehan too for chatting us through their solution.

hitachi

I stuck around in the solutions exchange until the VMworld party as the party is in the convention centre. The party seemed smaller this year although there was a big roller rink in the middle last year so possibly this was the reason. It was good to chat to very vNerds and even some ex-colleagues whilst waiting for Simple Minds to come on. I’m only 31 so I only knew two or three of their songs but they were hands down better than Taio Cruz last year and most of the crowd seemed to really enjoy it and they even did an encore. From the party I met up with some of my Xtravirt colleagues for a night cap.


Leave a comment

VMworld Day 1

Tuesday is the real start of VMworld where both partners and customers of VMware come to attend sessions, do hands on labs, talk to vendors in the solutions exchange and attend the keynote/general session.

The day kicked off with the general session, I opted to not go into the general session hall but instead go into the hang space across from the hall where the keynote was being shown on big screens. This enabled me  to sit at the bloggers table to ensure my scheduled blog postings around a number of announcements could go out smoothly and in San Francisco the keynote overran into the first sessions and I had one booked at 11am. The blog postings I posted which the ones I had to make sure the scheduling worked for are:

I was planning to mention quite a bit about the keynote but it was 98% exactly the same as the VMworld US one with even the same jokes. If you missed the keynote you can watch it again here. The big announcements from the keynote for me was the announcement that there is now a vCloud Air datacentre in Germany allowing the selection of this datacentre as the location of your data. For those who aren’t from Europe, many countries in Europe have strict regulations about information leaving their countries and Germany is one of the strictest so giving the ability to have customers data in Germany makes things a lot simpler. The second big announcement for me was that HP and Hitachi Data Systems are  have joined the VMware EVO:RAIL program.

Just like in VMworld US, the keynote ran overtime so I started walking to my first session which was MGT1969 vCloud Automation Center and NSX Integration Technical Deep Dive . The session was really informative and the two speakers gave some great insight into the integration and capabilities of the two products as well as doing a live demo at the end. I always appreciate a good demo so i would highly recommend watching the session once the recordings are available.

I had a quick lunch as most of the 11am sessions were delayed due to the keynote and then went up to the solutions exchange to talk to some vendors I wanted to hear more things about. The solutions exchange certainly doesnt seem to have as many vendors as last year and it was also very interesting to see how some vendors stalls have doubled in size whereas a few others have got a lot smaller and moved to the outer edges.

I then went to the hang space to watch a few vBrownbag Techtalks which were really good and also to chat to some fellow vExperts. for me one of the best parts about VMworld is being able to chat to your peers about technology and also make good connections professionally with partners companies. whilst i was in the hang space I also attempted my paper airplane challenge for project Destination Give Back which allows you to create a paper airplane and then depending on how far you throw of if you land on one of the circles you “win” money for a charity cause of your choice. Yet again I threw mine too hard Smile but it’s a quick and easy way to give back to good causes and I applaud VMware for doing it. giveback

My next session to attend was TEX1991 vCenter Orchestrator – What’s Next? which was a good session giving insight into you guessed it, what’s new in vCO. it was a good session and there really are some great things coming out in vCO that will help both SMB and enterprise customers.

I again did a walk around the solutions exchange after this as it was then the hall crawl where drinks and snacks are supplied before making my way to the vExpert/VCDX party where I managed to chat to loads of people about my previous VCDX attempt and my plans for my next one and lastly I attended the Cisco vJamon party. Both parties were really good and I must be getting old as I quite liked that there was good food and no thumping music so that I could chat to people with ease.

If you spot me at the conference please do come say hi. I will be wearing a vBrownbag shirt with my name on the front and back.


9 Comments

What’s New in vRealize Automation 6.2

Today at VMworld Europe, VMware are going to announce vRealize Automation 6.2 which is the renamed vCloud Automation Center solution but obviously the next version which is due to be available in Q4 this year. It does seem like there is a new version every six months of the solution as vCAC 6.1 was only GA 6 weeks ago which added a whole host of new features.

Below is an overview of what is being added in the vRealize Automation 6.2 product, fortunately there isn’t a change to the architecture so for those who have recently deployed vCAC 6.1 to customer like I have recently you don’t have to stress about doing the upgrade like it was between previous versions.

Upgrade and Migrate to vCAC 6.1

Release 6.0.1.1 to release 6.1

  • 6.0 must first be upgraded to 6.0.1.1
  • In-place upgrade from 6.0.1.1 to 6.1
  • Application Services (AppD) requires side-by side migration

Release 5.2.1 to release 6.1

  • Older versions must be first upgrade to 5.2.1
  • 6.1 will be installed side by side with 5.2.1
  • A migration utility will move data from 5.2.1 to new 6.1 deployment
  • Will require some system down time
  • Does not include AppD

vRealize Automation 6.2 Summary

Enhanced integration between vRealize Operations and Automation

  • Health status displays
  • Reclaims inactive VMs

Admin Friendly CLI

  • Simplify scripting of vRealize Automation commands

Enhanced Endpoint Support

  • vSphere 6 (Q1-15)
  • XenDesktop 7
  • Enhancements to vCloud Air

Proxy Support

  • Pay as you go support (Q1-2015)
  • OpenStack (Havana)

vRealize Automation 6.2 In-Depth

image

image

image

image

image

CloudClient

image

CloudClient Overview

  • Command-line utility that provides verb-based access with a unified interface across the vCAC APIs (including IaaS, Applications, vCO)
  • Focused on providing an easy-to-use command-line interface for the IT administrator where scripting and CLI use is more feasible than direct API calls
  • Stable interface while underlying APIs may change over time
  • Provides common security; exception handling; JSON, CSV and tabular formatting; file export; auto login for scripting (password and keyfiles); and auto-generated documentation.
  • Available as a separate Download in Early Q4 (supports 6.1)

Make sure you  watch the live VMworld keynote to learn more.


2 Comments

#VMworld Announcement #1 VMware EVO:RAIL – What is it?

 

imageAt VMworld US this morning VMware will announce numerous new solutions and one of these will be VMware EVO: RAIL I mean MARVIN I mean VMware EVO: RAIL, but what is it and what does it do. Below is a high level overview of the solution. Make sure you also  watch the live keynote to learn more.

Introducing VMware EVO: RAIL

image

VMware EVO: RAIL™ combines compute, networking, and storage resources into a hyper-converged infrastructure appliance to create a simple, easy to deploy, all-in-one solution offered by VMware qualified partners.

Simplicity Transformed

EVO: RAIL enables power-on to VM creation in minutes, radically easy VM deployment, one-click non-disruptive patch and upgrades, simplified management…you get the idea.

Software-Defined Building Block

EVO: RAIL is a scalable Software-Defined Data Center (SDDC) building block that delivers compute, networking, storage, and management to empower private/hybrid-cloud, end-user computing, test/dev, and branch office environments.

Trusted Foundation

Building on the proven technology of VMware vSphere®, vCenter Server™, and VMware Virtual SAN™, EVO: RAIL delivers the first hyper-converged infrastructure appliance 100% powered by VMware software.

Highly Resilient by Design

Resilient appliance design starting with four independent hosts and a distributed Virtual SAN datastore ensures zero application downtime during planned maintenance or during disk, network, or host failures.

Infrastructure at the Speed of Innovation

Meet accelerating business demands by simplifying infrastructure design with predictable sizing and scaling,by streamlining purchase and deployment with a single appliance SKU, and by reducing CapEx and OpEx.

Freedom of Choice

EVO: RAIL is delivered as a complete appliance solution with hardware, software, and support through leading
systems vendors; customers choose their preferred brand.

Hardware

VMware is not entering the hardware market. The EVO: RAIL software bundle is available to qualifying EVO:RAIL partners. The partner, in turn, sells the hardware with integrated EVO: RAIL software, and provides all hardware and software support to customers.

Appliance

Each EVO: RAIL appliance has four independent nodes with dedicated computer, network, and storage resources and dual, redundant power supplies.
image

Nodes

Each of the four EVO: RAIL nodes have:

  • Two Intel E5-2620v2 six-core CPUs
  • 192GB of memory
  • One SLC SATADOM or SAS HDD for the ESXi™ boot device
  • Three SAS 10K RPM 1.2TB HDD for the VMware Virtual SAN™ datastore
  • One 400GB MLC enterprise-grade SSD for read/write cache
  • One Virtual SAN-certified pass-through disk controller
  • Two 10GbE NIC ports (configured for either 10GBase-T or SFP+ connections)
  • One 1GbE IPMI port for remote (out-of-band) management

Fault Tolerance and Reliability

Each EVO: RAIL appliance has the following hardware components and reliability features:

  • Four ESXi hosts in a single appliance enables resiliency for hardware failures or maintenance
  • Two fully redundant power supplies
  • Redundant 2 x 10GbE NIC ports per node for all communication
  • ESXi boot device, HDDs, and SSD are all enterprise-grade

image

Automatic Scale-Out

EVO: RAIL Version 1.0 can scale out to four appliances – for a total of 16 ESXi hosts, 1 Virtual SAN datastore backed by a single vCenter Server and EVO: RAIL instance. EVO: RAIL handles deployment, configuration, and management, allowing the compute capacity and the Virtual SAN datastore to grow automatically. New appliances are automatically discovered and easily added to an EVO: RAIL cluster with a few mouse clicks.

Software

EVO: RAIL delivers the first hyper-converged infrastructure appliance 100% powered by VMware’s proven suite of core products. The EVO: RAIL software bundle is fully loaded onto the EVO: RAIL qualified partner’s hardware.
This software bundle is comprised of:

  • EVO: RAIL Deployment, Configuration, and Management
  • VMware vSphere® Enterprise Plus, including ESXi for compute
  • Virtual SAN for storage
  • vCenter Server™
  • vCenter Log Insight™

EVO: RAIL is optimized for the new VMware user as well as for experienced administrators. Minimal IT experience is required to deploy, configure, and manage EVO: RAIL, allowing it to be used where there is limited or no IT staff on-site. As EVO: RAIL utilizes VMware’s core products, administrators can apply existing VMware knowledge,
best practices, and processes.

EVO: RAIL leverages the same database as vCenter Server, so any changes in EVO: RAIL configuration and management are also reflected in vCenter Server and vice-versa.

Compute, Networking, Storage, and Management

EVO: RAIL Compute

Virtual Machine Density

  • EVO: RAIL is sized to run approximately 100 average-sized, general-purpose, data center VMs. Actual capacity varies by VM size and workload. There are no restrictions on application type. EVO: RAIL supports any application that a customer would run on vSphere.
    General-purpose VM profile: 2 vCPU, 4GB vMEM, 60GB of vDisk, with redundancy
  • EVO: RAIL is optimized for VMware Horizon® View with configuration options that allow up to 250 View VMs on a single EVO: RAIL appliance. Actual capacity varies by desktop size and workload.
    Horizon View virtual desktop profile: 2vCPU, 2GB vMEM, 32GB vDisk linked clones

EVO: RAIL Network

image

Connections

  • Each node in EVO: RAIL has two 10GbE network ports. Each port must be connected to a 10GbE top-of-rack switch that has IPv4 and IPv6 multicast enabled.
  • Remote/lights out management is available on each node through a 1GbE IPMI port that can connect to a management network. NOTE: In some configurations, there may be additional 1GbE ports that are covered and disabled.

Traffic

  • EVO: RAIL supports four types of traffic: Management, vSphere vMotion®, Virtual SAN, and Virtual Machine.Traffic isolation on separate VLANs is recommended for vSphere vMotion, Virtual SAN, and VMs. EVO: RAIL
    Version 1.0 does not put management traffic on a VLAN.
  • IPv4 and IPv6 multicast must be enabled on the top-of-rack switch(es). EVO: RAIL’s automated scale-out feature uses IPv6. (It is not required for your complete network to support IPv6.)
  • VLANs are not required when customizing a EVO: RAIL configuration; however, they are highly recommended.When using the Just Go! option, it is assumed VLANs are configured.

EVO: RAIL Storage

EVO: RAIL creates a single Virtual SAN datastore from all local HDDs on each ESXi host in a EVO: RAIL cluster. Virtual SAN read caching and write buffering uses SSD capacity. Total storage capacity is 16TB per EVO: RAIL appliance:

  • 14.4TB HDD capacity (approximately 13TB usable) per appliance, allocated to the Virtual SAN datastore for virtual machines
  • 1.6TB SSD capacity per appliance for read/write cache
  • Size of pre-provisioned management VM: 30GB

EVO: RAIL Management

EVO: RAIL enables deployment, configuration, and management through a new, intuitive HTML5-based user interface showcased in the next section. EVO: RAIL provides new non-disruptive updates for VMware software with zero downtime and automatic scale-out of EVO: RAIL appliances.

User Interface

image

Configuration Screenshots

Below are a few configuration screenshots showing how intuitive and easy it is to configure EVO:RAIL.

image

image

image

image

image

image

Use Cases

Below are some of the use cases for EVO:RAIL.

image

Make sure you  watch the live VMworld keynote to learn more.


Leave a comment

VCDX Spotlight: Joseph Griffiths

Name: Joseph Griffiths

Twitter Handle: @Gortees

Blog URL: http://blog.jgriffiths.org

Current Employer : IBM

VCDX #: 143

How did you get into using VMware?

I came into IT when virtualization was just getting started. The more time I spent on call in the middle of the night the more I became motivated to find solutions. Application clustering was too costly for the developers and no business unit would agreed to it. Then came VMware it provided a live solution to hardware failures and great manageability benefits. At first chance I encouraged a proof of concept using VMware. Within the next two years we were 90% virtualized.

What made you decide to do the VCDX?

At some point every technical person is faced with the choice to specialize in their field. When I looked at my possible options I was faced with some tough options. I have to choose between operating systems (Linux), Storage or virtualization. It was the same year I had the opportunity to attend my first VMworld (2012). While attending the conference I really enjoyed being surrounded by such a great eco system and company. I was able to have some great technical discussions with people and I love the conference. It became clear to me that I wanted to specialize in VMware. I needed to learn a lot more about VMware. I have always found that certifications make me learn with purpose so I started setting certification goals for myself. Since I had been in a technical role the VCAP-DCA made sense. Once I passed that test I just kept going.

How long did it take you to complete the whole VCDX journey?

I got a VCP5 on Feb 2012. The certification journey really started with VMworld 2013 when I passed the VCAP-DCA and IaaS exams. This was followed up by the VCAP-DCD in Oct. 2013. I started on the VCDX on January of 2014 and submitted the design May 2014. The VCDX is not really a destination it’s really about becoming something not achieving it. I feel that my life’s experiences from a young child are part of my VCDX journey. I spent two years as a missionary for my church knocking on doors in Michigan. I like to think that really prepared me to stand my ground in a design defence better than any mock defence ever could. At the same time I feel like I am still trying to become a VCDX, I have a lot to learn.

What advice would you give to people thinking of pursuing the VCDX accreditation?

I have lots of advice and there is a write up on my blog (poorly written). The three largest pieces of advice I can give are the following:

  • Don’t kill yourself, set goals and keep them but keep balance don’t sacrifice the world for a cert. Lots of people think they are going to get it done by pulling all nighters… don’t it’s not going to end well.
  • Your design does not have to be perfect.. it’s not about perfect, nothing is perfect.
  • The key to school is figuring out what the teacher wants… read the blue print figure out what the teacher wants and do it… don’t try to outsmart the teacher.
  • Find a format for your documentation and stick with it.

If you could do the whole VCDX journey again what would you do differently?

Spend less time trying to figure out the format and more time on content.

Life after the VCDX?  How did your company respond?  Was it worth it?

LOL… well I switched jobs the week before my VCDX defence so the new employer was happy. I am still getting used to life after and a new job. Was the VCDX worth it? Yes, in fact even if I had not got the VCDX it was worth it. I learned so much about design… preparing for the VCDX forced me to learn more in six months than the last two years. If your desire to become a VCDX is purely in order to get a new job or more money you may not be on the right path.

What is next for you?

Great question. More certifications just don’t tell my wife… I already have the VCP-Cloud and I just finished a massive vCloud project and I am moving into a VCAC and NSX project so VCDX-Cloud might be in the future. Short term I think it’s time for a CCNA to help smooth over a rough bit in my knowledge.


Leave a comment

VMworld US 2014 – The Calm Before the vStorm

For several years I have been very fortunate to attend VMworld Europe either via my company paying for the trip or in the case of last year, being able to attend as part of the vBrownbag crew and I’m very pleased to say that I will be attending this years VMworld US via the welcomed sponsorships of the vBrownbag sponsors (VMTurbo , Cisco , Brocade ,Infinio and Coho Data) for the TechTalks. Due to going as part of the vBrownbag crew VMware were gracious enough to give me a bloggers pass to cover my conference entrance fee and when I am not helping with the TechTalks or the VMunderground Open Acts i plan to blogging and tweeting away. But I am not only looking forward to going just for these reasons (certainly they are amazing enough reasons) but for several others and so I thought I would put out the reasons I’m looking forward to VMworld US and why if you haven’t booked to attend yet then why I would HIGHLY encourage you to register.

Social

142679-spongebob-square-pants-sponge-nerd

I know what you are thinking and yes there certainly are some amazing parties and there are people who sadly take it as a jolly rather than experiencing the conference but the social I am referring to is social media as well as actual human interaction with like minded people. I am sure a number of people are like me where we sit behind a computer for countless hours,then sit on our phone or tablet tweeting away to people about the latest virtualisation or related technology but have never actually met these people. In fact most of the people you tweet with are actually on the opposite side of the world but their blog posting/communities response/book/podcast/webinar or twitter response to a question you posted saved you countless hours of work or helped you get that new role or certification. Well VMworld is the perfect place to meet these people and thank them for their help, get your book signed by the author or throw the book at them if they were wrong (physical violence no matter how funny it may be from afar isn’t the answer…most of the time). This also allows you to talk about how cool the new features in vSphere 6.0 are and not get that placating nod your wife/girlfriend (husband/boyfriend for those super vWoman in the community) gives you when you get excited about it. For me the interaction and friendships I have had and made from VMworld conferences have sometimes been the best part as being able to chat to the person who wrote the book on VSAN/PowerCLI/VMware Networking for example is worth the conference fee in itself.

Sessions/Labs

The sessions,labs and announcements are brilliant and the only reason I chose social first is due to it being something not that many people think about. The sessions and labs are amazing and even though you can watch almost all the sessions (breakouts aren’t recorded) and do all the labs now via  labs.hol.vmware.com ,being able to attend the sessions for the week and hear about all the great new features and how people have taken the solutions provided by VMware and met their companies or customers requirements with them without being bothered by home life or work is an amazing learning experience. The same applies to the Hands on Labs where you can take the labs and skill up on the most recent technologies or even older ones that you might not have had the time to learn up until now. There are sessions for everyone as there are sessions where they are entry level for those people just getting into VMware technologies to advanced sessions where it is VMware engineers or product teams talking about the knitty gritty of the solutions. There are also loads of panel sessions ranging from meet the vExpert bloggers panel sessions to VCDX panel sessions where you can ask questions and learn from top vBloggers and or ask all those questions about the VCDX or the pre-requisites exams from those who have done it. If you are working for a VMware partner there is a partner day where as you guessed it, it is exclusively for partners and VMware will do sessions covering all the technologies and how they are working to make it better for partners or those selling their solutions.

TechTalks

Ok I’m probably very biased but the vBrownbag crew along with the help of our sponsors run the TechTalks from the community area where people who may not have had their sessions accepted to present at VMworld (this is not a reflection on the quality I can assure you) present about numerous different topics (no sales pitches) for ten minutes and they are streamed as well as recorded. The TechTalks have been a major success with loads of people watching the live stream, a very large number of views of the recordings and we also have a very good amount of live audience watching them. The schedule for the TechTalks is due out imminently and from having seen some of the amazing names on the list it will not disappoint.

Solutions Exchange

The solutions exchange is where all the vendors including sponsors have their stalls/booths where you can talk to them about their latest release, speak to some of their top people around possibly solutions you are looking to implement or need help fixing and even go to the VMware Expert bar. The Expert bar allows you to talk to the best people for each VMware technology and hear and see what all the new solutions from VMware can do for your business. As you would expect there are loads of freebies and competitions from all the vendors and this is the place where you can hear about that new technology and then be able to drop it in a conversation with your boss to show how on the ball you really are.

vmworld12-solutions exchange.png

General

There are also numerous activities that fall under the general banner like the VMworld party which last year had Train and Imagine dragons performing at the AT&T Park and three years ago were the Killers. There are also a number of vendor parties, parties exclusively for VCDX/vExperts and vendor excursions (brewery tours etc.) . The parties and meet ups in the evenings are amazing and if you have some self restraint and make sure you answer your phone when the wife calls, you can have an amazing time and still get the most out of the conference during the day. These are also a really great place to make new friends and even speak to some of the top names in the industry and realise they are 9 out of ten times really humble and friendly people.

If your significant other wishes to join you then there is spousetivities run by Crystal Lowe where vWidows/ partners of conference attendees can do day excursions.

Register Now!

If you haven’t registered for VMworld then I would highly recommend doing so here as it is well worth attending and if you need to justify it to your boss then why not use the VMworld letter for that. If you are attending then I would love to meet you and have a beverage with you or just chat tech. I will most likely be wearing one of my vExpert shirts or hanging around with the vBrownbag crew.

I am also planning to blog about a number of the announcements from VMworld so keep an eye out on my blog for those Smile

Gregg

Follow

Get every new post delivered to your Inbox.

Join 70 other followers