Goliath Performance Monitor Reviews

What is our primary use case?

What is most valuable?

Originally posted at https://www.cloud-buddy.com/?p=2154

This unique monitoring solution allows you to be proactive in the management of VMware vSphere infrastructure while at the same time simplifying operations. In this review I will talk about how you can leverage the functionality and unique architecture to accomplish this dual purpose.

Just recently, I had the pleasure to work with the good folks at Goliath Technologies and review their solution, Goliath Performance Monitor (GPM).

My first impressions of GPM were pretty positive. If you’re unfamiliar with GPM, for VMware vSphere it’s a single solution for providing monitoring across the 5 layers of the virtual stack including Application, OS, VM, Hypervisor and Hardware. So it’s a single pane of glass to monitor your entire stack. The version of GPM I am reviewing is 11.6.0.6.

The GPM Installation Process – Up & Running within Minutes

Goliath does an excellent job in creating an installation guide for the tool so I won’t go into detail about that. I just glanced over it and my deployment may have taken about 30 minutes or so.

Within minutes, I was playing with the monitoring tool’s consoles. One thing I would like to point out from the installation guide is the pre-requisites. You will need a VM or Physical Machine with the following settings:

• Windows Server 2008 R2 – 2012 R2
• At least 8 vCPUs and 12GB RAM (these are soft limits but probably a good idea to follow these when deploying in production)
• .NET 3.5 SP1 installed on the Virtual Server or Physical Machine
• Internet Explorer Enhanced Security disabled
• TCP ports 80 & 82 opened inbound
• Download the Goliath Performance Monitor software
• Proper credentials for the environments you would like to add to inventory (vCenter, XenServer, ZDC, DDC, etc.)

Goliath Performance Monitor vs vCOPs/vRealize Operations

Why XenServer credentials? Unlike some other popular tools in the space like vCOPs/vRealize Operations, GPM supports VMware vSphere and also XenServer, Hyper-V along with XenDesktop, XenApp and Horizon View.

So remember what I said about simplifying IT operations? You can use Goliath’s product to monitor VMware vSphere and everything else too. Not to mention you don’t have to fall prey to licensing that limits your functionality. Basically, you get full functionality with Performance Monitor on the base product, unlike some of its direct and indirect competitors.

As soon as the installation was complete, I pointed my browser to the IP address of the server the tool was installed on and this is where I landed.

From here on, it was pretty straight forward. I selected the first obvious choice, provided credentials for vCenter, and within seconds my whole lab was presented before me.

About GPMs vCenter Plugin & Impressive “Intelligent Agent”

The tool has a vCenter plugin that provides a single dashboard to monitor both physical and virtual infrastructure in vCenter. If you are not a VMware only shop, you will be happy to know that GPM has API integration with both ESXi and XenServer that captures key metrics about the host, virtual machines and storage agentlessly.

So what exactly does the agent do?

First of all, this is by far the most impressive agent deployment process I have witnessed. They call it the “Intelligent Agent” and I think for good reason.

It literally takes seconds for the Intelligent Agent to be deployed and communicating back to the mother ship. It is able to capture deep diagnostic metrics with little resource utilization, typically less than 0.1% of CPU & Memory utilization, and a 1.5 MB footprint.

GPM Can Monitor any Application

Once I deployed the agent on one of my windows machines, I started seeing this tool’s true potential apart from being hardware/hypervisor agnostic. You can literally tune it to monitor any application.

Take a look at the types of monitoring rules and alerts that can be set and think of your current gaps in monitoring. This is what I gathered; as long as the individual understands what the application does, Goliath Performance Monitor can monitor it effectively.

Needless to say, the agent provides a new level of monitoring that enables you to monitor services that are critical to your business, not just VMs and OSs, etc. And yes, it can be deployed from within the console as long as proper credentials are provided. The agent can get deployed on both Windows and *nix machines.

Some of the metrics that are captured are detailed and useful. The key is that they use both agentless (API) and agent based approaches to get all of the below metrics in one product. Also, each agent has log management capability built in for troubleshooting.

GPMs Metrics Will Help You Keep Your Sanity

This is the 5 layers of visibility:

Those are some critical metrics to monitor your infrastructure which will eventually help you keep your sanity. But what makes these even more valuable is the way they are reported.

Not only does it give you a detailed view of what’s happening with your environment at the moment, you can also get some real-time trending on the data and historically go back as far as you wish, or at least to the point where data began to be collected.

All the hypervisor metrics mentioned above can be retrieved in similar fashion. Apart from that, there are some canned reports that come with the solution and there is the option of creating more.

But it’s information like this across multiple aspects of your infrastructure that makes this tool stand out. You are able to run these types of reports for your entire stack.

If you have multiple sites or hybrid clouds in play, you will love the “Master Agent” functionality. I think this is the part that I really liked due to its simplicity.

GPM makes it Easy to Monitor & Manage Remote Sites

The Goliath Performance Monitor Intelligent Agents make it easy to proactively monitor and manage customer sites remotely. Any agent can be designated as a “Master Agent” at a remote site, behind a ­firewall, and con­figured to proactively reach out to the central Goliath Performance Monitor server if a condition is met and trigger an alert.

There is no need to deploy a separate server or proxy at a remote location. Note: Intelligent Agents are less than 0.1% CPU/ 30 MB Memory, click to deploy and easy to use.

So basically the agent we talked about earlier is all that is needed to make one of the boxes at any of the remote sites serve as the proxy for communicating with the GPM server.

Obviously because of its tiny footprint, performance should not be a big concern. But what if this remote server goes down? Well I would imagine GPM would trigger an alert as soon as that happens.

Also, there are notification capabilities that will allow you to integrate these alerts with most ticketing solutions. These are configurable at the alert level so each alert can follow a different notification method if need be.

A Few Areas of Needed Improvement

With all its greatness, the solution does have some areas of improvement. The Goliath team was very interested in hearing my feedback on this. They were keen to know how to make this tool even better.

In all honesty, I have been pretty impressed with what GPM offers. However, its GUI can use a little help. The navigation is not the most straightforward like many other monitoring tools. But it does solve an extremely complex problem; allowing you to monitor your entire infrastructure through a single pane of glass, the ultimate fantasy for most people in IT.

The Goliath team was very receptive about my comment on how I keep forgetting how I got to a certain screen because of the confusing navigation. They quickly acknowledged that and pointed out they are currently working on revamping their GUI to address those issues and will continue to come back to the community for further enhancements to the product. Look for my blog post later on the new UI when it is released.

The Verdict about Goliath Performance Monitor

In conclusion, I think Goliath Performance Monitor is a true winner. I can’t seem to pinpoint a tool that does everything it does. There are tools that compete with it in certain areas obviously, but I am not sure if there is any that delivers everything it does, the way it does.

It should appeal to businesses of all sizes. The support I got from the Goliath team in getting me familiar with the tool was phenomenal. If their actual support team has the same attitude, then you cannot go wrong with making an investment in them.

Speaking of investments, here is a link that will give you an idea on how much it will cost you to run this tool in your environment. But before you do that, I suggest you download a fully supported 30-day free trial of GPM and let the technology do the talking.

Lastly, Goliath’s hosting a live webinar focused on improving the VMware end user computing experience by gaining visibility into App & OS performance data to proactively remediate issues before end users are effected. This will be a good webinar to attend specially if you are looking into better monitoring your environment.

What is our primary use case?

What is most valuable?

Part 2/3. Originally posted at https://vthoughtsofit.blogspot.nl/2015/07/proactive-management-of-end-user.html#.Va9ZZvmqpBc

In my previous blog about Goliath Logon Simulator forCitrix, I stopped just after the Citrix XenApp and XenDesktop session was established. The last thing I showed you was the result of the Logon Simulator from the console. If you missed that article, it is a good start before reading this article, you can read the story here.

In this article I will go deeper in the product and show you how you can see very cool and wanted metrics within the Citrix ICA and HDX channel, and how you can monitor and debug a Citrix environment.

If we were to take a poll on the coolest report Citrix EdgeSight used to have, I'm sure #1 and #2 would be Logon Details and Session Startup Details, which gave very detailed information, step-by-step client side and server side. Logon Details gave insight in GPO load time, logon scripts and so on.

Together, these features are a killer combo, but they were hidden in a license that was hard to sell and now Citrix decided to kill all cool features to start fresh, leaving you and me thinking of the past.

No worry, those two cool reports are still there, not delivered by Citrix but through Goliath Technologies. When you do proactive monitoring with the Goliath Performance Monitor the agent measures all this data and will report this to the console. The great people at Goliath added this report in the console so life without EdgeSight is wonderful again.

Enough talk, let me show you what they have in the product.

The most important metrics you want while monitoring a Citrix environment are:

• ICA/HDX Latency
• GPO load time
• Bandwidth and congestion
• Connection time to the broker/web front
• User profile load
• vGPU performance (becoming more and more common)

Reports

Goliath offers several reports that will help you understand the end user experience. Just to remind you, Goliath performs simulated Citrix XenApp and XenDesktop user logon with actual user accounts. With that in mind you can understand that loads of data is gathered.

Each session is stored and can be debugged in details afterwards if needed through a search function. I started a couple of sessions over a few days to get some data.

In my last article we primarily looked at the reporting of the Citrix Logon Simulator section, now we focus on the section XenDesktop/XenApp session which is much more interesting for IT guys. In the report below you see two sessions that were active, if you look closely you see two important metrics right in the open.

The logon time and the ICA latency are reported already, giving you instant information about the user experience. So were done, right... or wait there is more, so much more.

Logon duration

If you want to see more data you click on the + mark next to the session, and you get into the reporting part. A number of tabs and sub tabs will open where you find detailed information about the session, the server and the user. First we start with the logon duration that was shown also in the main screen.

The logon duration is more than just logon, it is made up of several steps that together make up the logon time. The logon time is made up of the following steps:

• Logon time
• Client validation & brokering
• Authentication
• GPO
• Scripts that run
• User profile

All are shown in the report and the time they take, also per step a detail is given.

If you look at the details in the report above you see that it shows exactly what server, domain, etc. is talking to. This is the kind of detail you want in a report when you debug slowness, for instance.

If we look at the break down of all of this, what I used very much in EdgeSight was the Start Detail Report because it showed all aspects of the connection. If you never worked with EdgeSight you might think it a silly name with lots of letters but they all actually stand for something.

CASD for instance is Credentials Authentication Server Duration. In plain English, that translates to how long it takes to get your credentials verified. On the client side you have LPWD. It’s not a police force, it's Launch Page Web Server Duration, which means how long does it take to launch the web page (Storefront or Web Interface). Depending on your environment you get different values and more or less values. There are lists on the Internet to tell you what the abbreviations mean, I've included one that was written for Edgesight.

ICA Channel

A detailed report about the ICA Channel delivers metrics that are important to understand the end user experience. The ICA channel performance will be different from normal network performance. Latency for the ICA channel and network latency can be different.

Here you also find ICA Latency, a very very important metric to be measured. Together with the bandwidth and network latency, this gives a good indication whether the user is having some issues. Latency is the time it takes for a package to travel from one point to it’s destination. The higher the number, the worse your user experience gets.

Next to latency there is available bandwidth, not to be mistaken with speed. The available bandwidth has a direct influence on the latency, so if your pipe gets congested, latency goes up.

This has nothing to do with the speed of your connection. You can have a 100M connection but when it's congested, it will not perform. To solve congestion you add more pipes. Unfortunately that doesn't mean latency will go down at the same rate, latency can have more influencers.

Goliath offers a report that shows these metrics together so you see the relation between them.

Virtual machine

There is an option also to look at the virtual machine and see numerous metrics that will help you understand the performance of the user session and the machine it lives on. This virtual machine metric dashboard has many other tabs showing relevant information about the server. The following tabs are shown:

• CPU and Memory
• Disk use
• Disk Peformance
• Disk Space use
• Network Throughput
• Storage & VM Limit
• Agent Up&Down
• Graphics Metrics
• Storage Trends
• Storage Allocation
• Storage Usage

Well if that doesn't give you enough information I don't know what will, let's take a look at some of them.

If we look at server disk performance, we see the performance of the disks, throughput and IOPS being displayed. In my lab with one or two users there is no issue but in a live environment this might be valuable and show if the user is having issues because of a lack of IOPS.

A minor report is the Disk space use which allows you to identify conditions where there is unchecked disk space growth on your diff and identity disks.

Network throughput is important in solving issues with end user experience. If for some reason your network speed is low, it might impact the end user experience.

As I said before speed is not the most important factor in end user experience. but a lack of speed also doesn't help. All metrics work together to deliver the best performance. Think about the E1000 versus the vmxnet3 NIC and the performance difference it gave.

vGPU Performance

One of the cool features I think is the ability to monitor the usage of vGPU with their Performance Monitor for NVIDIA GRID vGPU. Goliath is working closely with NVIDIA to capture the data of the cards that need to be captured. I borrowed some screen shots from Goliath because my home lab is not equipped with a grid card. If you monitor an environment without a vGPU this tab won't be visible.
Metrics you find here are;

• Frames per second
• vGPU Compute Utilization
• vGPU Memory Utilization

Application performance

When debugging or monitoring sessions you need to know the context of the issue the user is experiencing. The context of the user experience is to know which other processes are running and using resources. The application performance report is doing just that; it shows the other processes running with metrics per process.

Session properties

A good start is always the overview of the session you're debugging. Without a good sense of the session the metrics say nothing. Together with Citrix Director, which does a good job of showing information about a session, and this report also shows the session properties.
Here you can verify versions, networking details and so much more, so I think it's a good starting point and a good report to end this article with.

I think Goliath offers a very good tool to do simulated Citrix logons with actual user accounts and that the reports are useful to monitor and debug a session. If you look for a monitoring tool to look at the user logon performance of your Citrix environment, Goliath would certainly be able to fill that gap.
The addition of vGPU is something that will be needed more and more, even Citrix XenApp servers will get graphic cards in the near future.

Final Thoughts

I spoke to Goliath about the next versions of the tool and as I wrote in my previous article. Starting an application is something that might be useful because that is a user action that might also vary in time. If they could start an application (e.g. Word) and report time it takes to load certain plugins, that would be useful.

Another addition would be to be able to do exactly the same as they do with Citrix in a VMware Horizon View environment. It all depends, of course, on VMware opening up the API's to allow them to ge the data from the channel. In my job, I see a 50/50 in deploying Citrix and Vmware, and for VMware there are less options to do simulated monitoring.

Perhaps integration with vCops, or as it is now called, vROps (vRealize Operations) would be interesting because all data is collected there already although not all our customers have that running.

If I had to make a choice, it would be both ways. Integrate and be independent as well to accommodate both customers.

I think Goliath offers a very good tool to do simulated Citrix logons with actual user accounts and that the reports are useful to monitor and debug a session. If you look for a monitoring tool to look at the user logon performance of your Citrix environment, Goliath would certainly be able to fill that gap.
The addition of vGPU is something that will be needed more and more, even Citrix XenApp servers will get graphic cards in the near future.

Part 1/3. Originally published at https://vthoughtsofit.blogspot.nl/2015/05/goliath-logon-simulator-for-citrix.html#.Va5lKfmqqko

In my line of work, I come across a lot of products that offer similar features or come close to each other. To make sure I know the differences between the good, the bad and the ugly, I test all of them.

In my home lab, I setup a product and do a functional test. In that test, I try to look for similarities with other products and features that are exceptional. As I work for PQR, the products we sell is not in my hands. I can advise in favor or against but nothing more than that. Still, I think for any consultant, it is valuable to know the competitors’ products and have a basic understanding of them.

The same goes for the product that I'm currently testing, Goliath Logon Simulator for Citrix. There are other logon simulators and products which offer similar features. I also wanted to see what Goliath is offering because they are a company whose name I hear more and more, so I added them to my bucket list.

This post will show you how to setup the Goliath Logon Simulator for Citrix and what it does. You will see the results you get from the simulation, and in which scenarios it would benefit. Last but not least, to show the value of the product I will shed light on aspects like licensing and scalability.

My personal review concludes this post.

An intro to Goliath Technologies

Goliath Technologies is an US company based in Philadelphia, Pennsylvania with two development centers in other locations in the US. With over 400 clients, they are an ever growing company and their business is all about being proactive.

Enough about the company, let's take a look at the software they make. If you look at their software catalog you see the following list:

• Goliath Performance Monitor for Citrix XenApp/XenDesktop, VMware Horizon view
• Goliath Performance Monitor for vSphere, Hyper-V and XenServer
• Goliath for NetScaler
• Goliath End User Experience Monitoring and Management
• Goliath Logon Simulator for Citrix

It's quite a list and I can't handle it all at once, so I’ll start off with the newest software, the Goliath Logon Simulator for Citrix XenApp and XenDesktop.

The Goliath Logon Simulator for Citrix

There are many products that provide a logon simulator for Citrix, so what is a logon simulator? With a logon simulator you logon with a real user on a real Citrix server and therefore get real results on what the performance looks like

Components

For a logon simulator to work properly you need to setup some components. Goliath’s Logon Simulator uses the following components to do the job:

• Management server
• Agent
• Database
• Client to start the session from

Of course a working Citrix environment is a nice to have if you want to do some testing (it's a must have of course). My lab is setup with a working Citrix environment. It uses one server as the Controller, Storefront and license server and one server as the XenApp server.

The Goliath server is the Management server and is also the server from where the tests are run. I try to keep my lab small so I can run many products at once; no need for performance, functionality is king to me.

Setup

Setup of the Logon Simulator is done with assistance of Goliath. In a GoToMeeting or WebEx session they walk you through the setup and familiarize you with the product. I have to say they are great people to talk to and you learn while installing and configuring.

When you set it up you need to take care of a couple of things:

• UAC has to be disabled. If it is not disabled you won't get it to work
• The user account you test with should be Administrator to run the agent
• A demo user account with access to the application or desktop
• The Management server needs pretty steep hardware, 4vCPUs and 8GB RAM
• Internet Explorer 11 or newer on the system will execute the Citrix session
• There are more small requirements, like .Net 3.51 SP1, but that is minor
• There are some other setup things to do but not worth to mention, just tuning to make sure your users logs on fine and logs off even better
• After you install the agent on the server(s) you are ready to setup a test.

Scenarios

There are two possible scenarios to setup with Goliath’s Logon Simulator:

• Testing the Citrix Delivery infrastructure
• End user troubleshooting

The second scenario is used when you deploy the agent to a user’s home computer and see where the issue is. You would get data where the logon is not working fine. We won't look into that scenario here right now, we will begin with scenario one. We'll get back to the second scenario later on.

Scenario1: Setting up the logon simulation

Start the MonitorIT website with the icon on the desktop of the management server. The main screen will start.

Goliath’s MonitorIT is a tool that allows you to add monitoring rules to test numerous things. When you open monitoring rules you see a vast list of rules that are available. If you can't find the rule you are looking for (which is hard to imagine) you can create one yourself.

With the help of the team from Goliath, I created a rule called Citrix Logon Simulator test Launch of Desktop to test my Citrix environment.

When you create a new rule you have a couple of options, and the screen that pops up is shown here. In addition to testing a Citrix logon you could periodically test if a service is still running or watch a file or something similar.

There are many more options for monitoring a specific thing rather than building and end to end solution. All these options are nice to have extras that come with the product when you run the Logon Simulator. I did not test these because the logon simulations was priority.

If you click on the item Citrix XenApp Watch you see drill down and monitoring options that are Citrix specific. In addition to running a periodic logon simulation, you might be interested in doing some other tests on your Citrix environment like watching the load on the server or keeping an eye on the latency. Again, nice options to have that come with the package, but probably will cost you a few extra licenses.

In the rule we just created, there are a few items to be configured:

Make sure you select one server where the session is started from. I selected the management server because that was easiest in my lab. In a real time environment you would have a couple of virtual machines that are dedicated to test the Citrix environment.

If you have multiple locations and you want to test access from those locations it might be a good idea to start a session from there periodically. If you want good data and proactive signals that there might be an issue you would need to attend to, you would schedule the simulation to run periodically as best fits your organization.
If you want the notification to be sent out by email, SNMP or log to a Syslog server you can set this up on the notification tab. You can integrate the Logon Simulator with any other monitoring tool and combine the results with an end-to-end monitoring solution.

On the schedule tab you can select when and how often the job is run. I selected every 1 hour so I had time to look around in the console after each run. There are many options to be configured and depending on your setup or needs you would configure them accordingly.

There is also the remediation option that gives you the option to start a remediation action if an error occurs. You need to think this through and configure it for your needs, it's just a five-step-click to get it up, but it will take some testing and tuning to make it yours.

After you set it all up you sit and wait. At the specified time, you will see an Internet Explorer tab appear and the Storefront site appear. The user you specified is automatically entered as well as the password, so you don't need to do anything there. Just sit back and relax and see the process do the job.

The resource is displayed like you would expect, here we only had one desktop as a resource, so the Goliath Logon Simulator had to start that one. As expected the Simulator starts the application (the desktop) and the logon process starts. Behind the Internet Explorer screen you notice the session is being started, but it went too fast for me to change the screen and capture it.

After a few seconds the session is logged on, the session will stay like this for a few seconds to make sure everything is finished. After that period, the log off is initiated automatically. The XenApp server is landing on a basic install with Office 2003. It’s nothing fancy, just a very fast logon

After the session has logged on successfully this is shown in green, when it is red you will see that there is something wrong. When you have scenario two, you would see what is going wrong for that user in the logging shown there. More on that soon.

In the next screenshot below, you will see the details of the logon session.

As you see below every step is displayed in detail and you will see where something went wrong if there is a performance issue.


In the View tab you get more details about the session you launched and some of the metrics of the server. It will give you a reference as to what the environment was like when the session was run. Logon times might be longer during the day, but that doesn't have to be alarming because a server might be a bit busier during those hours.

If you look at the XenApp/XenDesktop session tab you will see all the user session data in the XenApp environment. Because the agent is running there, you will also get detailed information about those logons. There will be a breakdown of how long the authentication took, how long GPO loading took, and so on. I think that's a nice to have extra with the tool.

You can visually see the logon performance in a graph. Of course, with just one task running it's a simple graph. With multiple tasks running for days it will show how your environment is running and you can take action if needed.

Extra functionality

Because the Goliath Logon Simulator is part of an actual monitoring tool you get more information about servers than just the logon performance. With the agent running and the management server seeing all the servers around him or her, you will get some extra data. See this as a benefit.

So if you look in the monitor tab you will see several options that might be interesting if you want to know how your servers are performing.

There are several options, and I'm not going to talk about all of them, but you can monitor the CPU, memory or the storage of the servers. If you want to monitor servers, you can get an instant quote using Goliath’s online pricing calculator.

Scenario 2

Before we head for the review section let's talk about scenario 2. Scenario 2 is the scenario where you can use the Goliath Logon Simulator as a debugging tool. Let’s say you have a remote or local user who has issues logging on to the Citrix environment. You have no clue why and can make no sense out of her story.

Take a look at the screenshot you saw before. It is the result screen of the session that is started, and every step along the way is there. If for some reason anything with her Citrix receiver was wrong it would show up here.

The Goliath Logon Simulator starts up, opens the web site, and is stuck on being unable to find the receiver. In my test, we did a fairly easy setup with just the client connecting to the Storefront and the controller getting to the XenApp server.

In a more serious scenario you would connect through NetScaler as well with 2FA implemented and you are testing that one periodically from each of your branch offices. In my setup the Controller, License Server and Storefront are one server. In production that will never happen and thus will it be more complex and more meaningful to test.

Personal Review of the Logon Simulator

Now that you've seen how the product works let me talk about what I think about it. First let’s look at the pricing model. Pricing is easy as you license per instance. There’s nothing difficult about that.

Licensing

Many products are not open about their license costs, but Goliath is very easy about licensing. If you visit https://goliathtechnologies.com/pricing/ you will be able to enter the number of a certain license you want and request the quote.

The Goliath Logon Simulator is priced between $3000 and $4000 per simulated user with even lower prices for enterprises with over 20 users.

Scalability

Scalability is key in production environments with multiple branch offices. With Goliath there is no limit to scalability as the sessions are started from machines you setup to do sessions. If you have 20 branch offices and you deploy 20 machines to logon periodically, that's just fine.

The management server is set up with such steep hardware that you should be able to handle 20 agents reporting.

Support

Support is a very important factor in any IT environment, with all dependencies getting software running, you sometimes need a little support. While we were installing the software and did a test run, we encountered an issue. In these occasions, you get to know the company and they passed with all regards.

We had a couple of sessions to troubleshoot and after a session with Heather from Goliath’s Tech Team, I knew things would be solved quickly... resulting in an e-mail this morning with a fix.

Functionality