Posts Tagged ‘Continuous Integration’

Sauce Updates OnDemand Plugin for Jenkins Pipeline

August 10th, 2016 by Ken Drachnik

We have updated our OnDemand plugin for Jenkins with explicit support for Jenkins Pipeline. This update enables development and testing teams to easily create, manage, and run automated tests using scripts on Jenkins, resulting in faster testing.

The newly enhanced OnDemand plugin enables Sauce Labs users to skip the Jenkins UI and run tests directly via scripts. Previously, users had to work within the Jenkins UI to create testing tasks. While this is initially convenient, as automation grows and becomes more complex, the process of creating testing tasks becomes more complex, too. Now OnDemand enables testers to automate releases for complex and non-sequential tasks that previously required manual intervention.

Key benefits of the update include:

Create scripts to automate Jenkins operations
Save time by scripting test sequences that can automate testing, retry tests automatically and run processes in parallel. Developers and QA can more easily customize their Jenkins workflows and reporting results.

Automatically create test scripts for Jenkins
Use the Jenkins snippet generator to easily create Pipeline scripts to execute Sauce Commands via Jenkins. Users don’t need to know how to script in Pipeline – simply copy the code snippets to program workflows

The Sauce OnDemand Jenkins Plugin is available as a free integration. Download the plugin from Jenkins and read how to configure it on our docs page.

Happy Testing!

New: Use Atlassian Bitbucket with Sauce Labs

May 24th, 2016 by Ken Drachnik

The Sauce Labs Ecosystem & Integrations team is proud to announce our latest ecosystem integration: Sauce Labs for Atlassian Bitbucket Pipelines. Bitbucket Pipelines is a continuous delivery service built right within Bitbucket Cloud that gives developers end-to-end visibility from coding to deployment.

As more and more devs work in agile teams, they increasingly rely on their code repos to manage code, threads and bug fixes and many use Bitbucket. As a code collaboration tool, Bitbucket is an amazing tool for managing code across large teams.

With Sauce Labs and Bitbucket Pipelines, it is easy to launch your automated Selenium and Appium tests as part of your Bitbucket Pipeline build process. Sauce Labs allows users to reduce their overall build time to as low as a couple minutes through cloud based test execution and massive parallelization. You can also leverage the over 700 browser and OS combinations including real mobile devices through Sauce Labs for Bitbucket Pipelines.

Bitbucket Pipelines is currently in Beta. To enable Bitbucket Pipelines visit Bitbucket Pipelines Integrations. You can learn more about the Sauce Labs integration on our documentation wiki.

Also, visit the Atlassian Marketplace to see additional Sauce integrations available for JIRA and Bamboo.

Happy Testing!

JIRA is Just a Click Away with Our New Plugin

May 3rd, 2016 by Ken Drachnik

As more and more devs work in agile teams, they need tools to plan, track, and release software and many of them use JIRA. As a tracking tool, JIRA is amazing for collaboration and project planning. For many teams, JIRA is the place of record for everything in the software development lifecycle. We have found that many of our customers use JIRA and the #1 product ask was to integrate Sauce Labs’ test results with JIRA so it would be simple to track all the tests associated with a project in one place.

Let’s say you are running an automated or manual test on Sauce Labs and find a bug. You want to add it to JIRA so that someone on your team can take a look or so that it can be prioritized in the backlog. Historically, one would have to download all the Sauce assets, login to JIRA, create a ticket, and upload the assets again. This can be tedious when you’re running lots of tests.

With Sauce Labs for JIRA, this is all simplified and automated. With the click of a button you can now create a JIRA ticket directly from your Test Details page. The plugin gives you the option to upload the screenshots, logs, and video link to your tests, making it easy to share out among your team.

To download Sauce Labs for JIRA, visit the Atlassian Marketplace: https://marketplace.atlassian.com/plugins/sauce-jira-integration/cloud/overview.  To read more, visit our JIRA integration Docs page.

Happy Testing!

The Sauce Labs Ecosystems & Integrations Team

Try Making It Smaller – It’s The Agile Way

November 4th, 2015 by Greg Sypolt

Agile is a must for development shops. Agile is a mature, iterative, collaborative methodology that breaks the development process down into shorter sprints. At its core, Agile development is about small iterations, test automation and a continuous integration pipeline.

Waterfall Was Created For a Perfect World, But We Don’t Live In One

Agile is a reaction to the slower, sequential approach known as Waterfall. Where Waterfall requires upfront planning to ensure that all details are accounted for, with no room for surprises or changes, Agile accounts for the inevitability of change, adapting to the project as it unfolds.

“Imagine a waterfall on the cliff of a steep mountain. Once the water has flowed over the edge of the cliff and has begun its journey down the side of the mountain, it cannot turn back. It is the same with waterfall development.”  (Search Software Quality)

To understand the advantages of Agile, it’s important to first understand the more traditional Waterfall methodology:

  • It is a sequential design process: discover, plan, build, test, review
  • Each project is based on the extensive collection of clear documentation gathered at the beginning
  • The whole product is only tested at the end of the cycle
  • It doesn’t take into account a client’s evolving needs or leave any room for revision (more…)

The Benefits of Parallel Testing

August 6th, 2015 by Greg Sypolt

Running in slow motion?

Are you running, but can’t make your feet move as fast as you want them to? This is a common feeling among beginners, as well as experienced automation developers. As your regression suite grows, it takes longer to run tests, and soon you have a problem because your regression suite is running longer and longer. There are a few approaches to smarter testing: reduce the number of tests, only run the tests applicable to the change, or optimize the test execution.

Marching toward continuous integration

As your software development team marches toward Continuous Integration (CI), the process involves a lot of automated testing. Even automated testing consumes precious time, so you need to ensure your automated tests are designed to scale. If a particular change is going to cause one or more tests to fail, the team needs to know about it as quickly as possible. Developing scripts to be lean and independent allows for fast feedback to developers.

Let’s unleash the power of parallelization

Use parallelization to speed up slow automated UI tests, and set a standard to develop lean and independent starts. A single cucumber scenario can easily take minutes to run. When you have a lot of scenarios, they can quickly compound your suite and take several minutes or hours to complete. No one wants slow automated tests — tests so slow that they only run a couple of times per day. Everyone expects automated tests to be launched for every build and send feedback within minutes, not hours. Set a standard for every build: the test execution must complete and send feedback within 10 minutes. (more…)

The All New Sauce Labs UI

June 11th, 2015 by Ken Drachnik

New UI screen shotAs Sauce continues to grow its functionality, we try to be thoughtful in how we make changes to our UI to accommodate new features. Today, we are proud to announce an entirely new graphical UI that enhances Continuous Integration testing workflows, available immediately. Our new UI provides better insights into software builds and test processes. It’s all of our work here at Sauce to help users speed up their application testing to bring their new software applications to market faster.

Here’s a look at what’s new:

New Dashboard
Our dashboard now offers a summary view on the status your builds and tests across your organization. It automatically groups tests into builds so you and your team can concentrate on the status of desired builds rather than on individual tests, helping you to quickly identify blocking issues.

Updated Tests and Tunnels Pages
Now you can click on a build to receive complete details on all tests within it, as well as highlight the ones that have failed. You can also view the status of each individual test, Sauce Connect™ tunnels.

Team Management and User Details
We know it can be difficult to track usage of third party tools across your organization and ensure they’re being effectively used. That’s why Sauce now offers some new enterprise management features that make it easier to manage permissions and access to testing specific resources. Now you can benefit from enhanced reporting, giving your organization insight into individual usage via 60-day graphs.

New Archives Page
This feature for the first time offers a searchable archives page to show all of your account activity over the past 90 days. Your team can easily view the history of their work to help them spot trends in application tests using custom queries or existing filters.

Single Sign On (SSO)
And finally, we know that provisioning new accounts for individuals can be a time consuming process. Sauce now supports SSO, enabling IT managers to “just-in-time” provision new user accounts with centralized account management and access control.

We are excited about today’s new updates and hope you are too. To learn more about what’s new, you can view a Webinar explaining the new UI.

Want to try it? Sign up for a free 14 day trial.

 

Test Automation KPIs

June 3rd, 2015 by Greg Sypolt

One of the interesting things about automation is that it frees you up from time-intensive manual testing, allowing you to spend time on strategic elements—because if you do not spend time on strategy, your capabilities as a team will not grow. And part of that growth means focusing on valuable metrics— metrics that will help you learn, and improve your processes.

Once you have processes in place, the next crucial step is to invest in automation. Automation helps you work faster, and makes your work consistent, traceable, and shareable, which is also imperative. All this comes only after establishing the right KPIs (key performance indicators).

Automation: Deliver Faster, from Months to Minutes

Ask yourself this question: without CI (continuous integration), how long would it take your organization to deploy a change that involves just one line of code? For instance, say your organization sets an objective to deploy a change in production within 30 minutes. To achieve this objective, everyone has to agree on the tools and processes that are needed for an easy button approach (aka continuous integration).

Let’s review the roles, team responsibilities, and the CI process. (more…)

Beyond the Release: Continuous Integration The Transforms Organizations [Webinar]

May 20th, 2015 by Bill McGee

Continuous Integration is not simply about automated releases, it is also about knowing about how your software delivery pipeline works – its weak points and how it is performing over time, critical data points to make sure your CI system is healthy and sustainable.

In our next webinar, Chris Riley (DevOps Analyst), Andy Pemberton (CloudBees) and Abhijit Pendyal (Sauce Labs) will show you how Jenkins and Sauce Labs can work together to build a comprehensive CI tool set to help you release your desktop apps faster, at a higher quality and with more visibility.

This webinar will cover:

  • How CI goes beyond releases and into pipeline optimization
  • The challenges in adopting CI and the importance of getting it right
  • Thought leaders’ insights into future possibilities for CI

Join us for this presentation next Wednesday, May 27 at 11am PDT/2pm EDT. There will be a Q&A with both Chris, Andy and Abhijit at the end of the presentation.

Click HERE to register today.

Want to read more about Continuous Delivery? Download the 2015 Guide to Continuous Delivery Research Spotlight.

Not Just Faster Releases; Better Understanding

May 7th, 2015 by Chris Riley

This is a guest post by Chris Riley, a technologist who has spent 12 years helping organizations transition from traditional development practices to a modern set of culture, processes and tooling.

In DevOps there are several processes and tools that go beyond their face value. System Analytics, Application Performance Monitoring, and Continuous Integration (CI) go far beyond their core abilities. In particular, CI not only changes the speed and quality of releasing code, it improves communication and finds bugs in the software development process itself.

One of my biggest messages for companies moving to modern software delivery is the idea of being deliberate. Being deliberate means picking a culture, process, and tools that focus on results and how to attain them. Too often tools, especially those that are open source, are adopted on a whim without much forethought. This is the converse of being deliberate; allowing the tools to define the process and culture for you.

When organizations follow the ‘deliberate’ approach, they naturally get to a place where they move faster and what they have built is sustainable. A huge component of getting to this place is CI. No DevOps shop can survive without a continuous integration process. It allows front-end developers to participate in quality, find bugs before QA, test new functionality faster than ever. (more…)

Best Practices in Mobile CI [WEBINAR]

April 22nd, 2015 by Bill McGee

Modern organizations today feel immense pressure to deliver better software faster, and this is no different in the mobile space. The best practice of Continuous Integration for web dev has been embraced for years as it is a proven mechanism that accelerates production cycles. However,mobile developers have been slow to adopt CI, despite needing a quick go-to-market plan.

In large part, this is because mobile brings with it a set of unique challenges that make implementation tough. Nevertheless, tools have evolved and mobile development teams now have many options to choose from to implement a solid mobile CI system.

In our next webinar, Kevin Rohling (Emberlight, Ship.io) and Kristian Meier (Sauce Labs) will cover best practices in implementing a mobile CI system and demonstrate how you can easily build, test, and deploy mobile apps.

This webinar will cover: (more…)