XWiki Enterprise

Fix automated UI tests that fail on Internet Explorer 9

Details

  • Type: Bug Bug
  • Status: Open Open
  • Priority: Major Major
  • Resolution: Unresolved
  • Affects Version/s: 4.1-milestone-1
  • Fix Version/s: None
  • Component/s: Build, Infrastructure and Tests
  • Labels:
    None
  • Similar issues:
    XE-1146Fix automated UI tests that fail on Internet Explorer 8
    XE-1195Fix automated UI tests that fail on Chrome
    XE-1176Exclude failing Selenium 2 tests on IE9 from running
    XE-1147Exclude failing Selenium 2 tests on IE8 from running
    XE-1218Allow skipping the unzip part when running automated tests
    XE-1199UI-tests ran on Chrome don't work properly because of CSRF validation issue
    XE-938Take screenshot when failing to find element in functional UI tests
    XE-833Migration of DeletePageTest from selenium tests to ui-tests
    XE-1194Exclude failing Selenium 2 tests on Chrome from running
    XE-812Migration of UserProfileTest and CopyPageTest from selenium-tests to ui-tests

Description

As you know, we want to run out enterprise-ui tests on IE8, IE9 and Chrome.

The failing tests on IE9 have been marked so the build won't fail.
The strategy is to slowly fix the failing issues until none of the test is ignored.

At the moment there seems to be a bug in surefire plugin which doesn't allow to run tests individually:
https://jira.codehaus.org/browse/SUREFIRE-827
https://jira.codehaus.org/browse/SUREFIRE-844

A good way to start is by fixing the tests that attach files. There are several tests in several classes that fail because the path the ui-tests want to use is malformed in IE9

Below is the list of tests that fail on IE9:

./src/test/it/org/xwiki/test/ui/administration/ImportTest.java-    public void testImportWithHistory()
./src/test/it/org/xwiki/test/ui/administration/ImportTest.java-    public void testImportWithNewHistoryVersion()
./src/test/it/org/xwiki/test/ui/administration/ImportTest.java-    public void testImportAsBackup()
./src/test/it/org/xwiki/test/ui/administration/ImportTest.java-    public void testImportWhenImportAsBackupIsNotSelected()
./src/test/it/org/xwiki/test/ui/administration/UserProfileTest.java-    public void testEditProfile()
./src/test/it/org/xwiki/test/ui/administration/UserProfileTest.java-    public void testChangeAvatarImage()
./src/test/it/org/xwiki/test/ui/administration/UserProfileTest.java-    public void testChangePassword()
./src/test/it/org/xwiki/test/ui/administration/UserProfileTest.java-    public void testChangeUserProfile()
./src/test/it/org/xwiki/test/ui/administration/UserProfileTest.java-    public void testChangeDefaultEditor()
./src/test/it/org/xwiki/test/ui/administration/UserProfileTest.java-    public void testChangePasswordWithTwoDifferentPasswords()
./src/test/it/org/xwiki/test/ui/administration/UserProfileTest.java-    public void testChangePasswordWithoutEnteringPasswords()
./src/test/it/org/xwiki/test/ui/administration/UserProfileTest.java-    public void testChangePasswordOfAnotherUserWithTwoDifferentPasswords()
./src/test/it/org/xwiki/test/ui/annotations/AnnotationsTest.java-    public void AddAndDeleteAnnotations()
./src/test/it/org/xwiki/test/ui/annotations/AnnotationsTestInOldSyntax.java-    public void xwikiPageSyntaxAnnotations()
./src/test/it/org/xwiki/test/ui/appwithinminutes/AddEntryTest.java-    public void testEntryNameWithURLSpecialCharacters()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ApplicationNameTest.java-    public void testEmptyAppNameWithNextStepButton()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ApplicationNameTest.java-    public void testEmptyAppNameWithEnter()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ApplicationNameTest.java-    public void testInvalidAppName()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ApplicationNameTest.java-    public void testExistingAppName()
./src/test/it/org/xwiki/test/ui/appwithinminutes/AppsLiveTableTest.java-    public void testDeleteApplication()
./src/test/it/org/xwiki/test/ui/appwithinminutes/AppsLiveTableTest.java-    public void testEditApplication()
./src/test/it/org/xwiki/test/ui/appwithinminutes/AppsLiveTableTest.java-    public void testActionRights()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testEmptyCanvasHint()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testApplyConfigurationChanges()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testDeleteField()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testReorderFields()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testRenameField()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testInvalidFieldName()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testDuplicateFieldName()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testSwapFieldNames()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testUpdateSheetAndTemplate()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testSaveAndContinue()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testFieldNameAutoGeneration()
./src/test/it/org/xwiki/test/ui/appwithinminutes/ClassEditorTest.java-    public void testRenameWithSaveAndContinue()
./src/test/it/org/xwiki/test/ui/appwithinminutes/DateClassFieldTest.java-    public void testDatePicker()
./src/test/it/org/xwiki/test/ui/appwithinminutes/DateClassFieldTest.java-    public void testDateFormat()
./src/test/it/org/xwiki/test/ui/appwithinminutes/LiveTableEditorTest.java-    public void testManageColumns()
./src/test/it/org/xwiki/test/ui/appwithinminutes/LiveTableEditorTest.java-    public void testSaveAndContinue()
./src/test/it/org/xwiki/test/ui/appwithinminutes/StaticListClassFieldTest.java-    public void testDisplayType()
./src/test/it/org/xwiki/test/ui/appwithinminutes/StaticListClassFieldTest.java-    public void testMultipleSelect()
./src/test/it/org/xwiki/test/ui/appwithinminutes/StaticListClassFieldTest.java-    public void testItemsEditor()
./src/test/it/org/xwiki/test/ui/appwithinminutes/WizardTest.java-    public void testCreateApplication()
./src/test/it/org/xwiki/test/ui/appwithinminutes/WizardTest.java-    public void testGoBackToFirstStep()
./src/test/it/org/xwiki/test/ui/AttachmentTest.java-    public void testUploadDownloadTwoAttachments()
./src/test/it/org/xwiki/test/ui/AttachmentTest.java-    public void testAttachAndViewGifImage()
./src/test/it/org/xwiki/test/ui/blog/BlogCategoriesTest.java-    public void testCategoryAddRenameRemove()
./src/test/it/org/xwiki/test/ui/blog/BlogPostTest.java-    public void testCreateAndEditBlogPost()
./src/test/it/org/xwiki/test/ui/BreadcrumbsTest.java-    public void testBreadcrumbs()
./src/test/it/org/xwiki/test/ui/CommentAsGuestTest.java-    public void testPostCommentAsGuest()
./src/test/it/org/xwiki/test/ui/CommentAsGuestTest.java-    public void testPostCommentAsGuestNoJs()
./src/test/it/org/xwiki/test/ui/CommentAsGuestTest.java-    public void testReplyCommentAsAnonymous()
./src/test/it/org/xwiki/test/ui/CommentAsGuestTest.java-    public void testCannotEditCommentAsAnonymous()
./src/test/it/org/xwiki/test/ui/CreatePageTest.java-    public void testCreatePageFromTemplate()
./src/test/it/org/xwiki/test/ui/CreatePageTest.java-    public void testCreatePageWhenNoTemplateAvailable()
./src/test/it/org/xwiki/test/ui/CreatePageTest.java-    public void testCreatePageWithSaveAndEditTemplate()
./src/test/it/org/xwiki/test/ui/DeletePageTest.java-    public void testDeletePageIsImpossibleWhenNoDeleteRights()
./src/test/it/org/xwiki/test/ui/EditInlineTest.java-    public void testInlineEditPreservesTitle()
./src/test/it/org/xwiki/test/ui/EditInlineTest.java-    public void testInlineEditPreservesTags()
./src/test/it/org/xwiki/test/ui/EditObjectsTest.java-    public void testChangeMultiselectProperty()
./src/test/it/org/xwiki/test/ui/EditObjectsTest.java-    public void testObjectAddAndRemove()
./src/test/it/org/xwiki/test/ui/EditWikiTest.java-    public void testSwitchToWysiwygWithAdvancedContent()
./src/test/it/org/xwiki/test/ui/EditWYSIWYGTest.java-    public void testUploadImageAfterPreview()
./src/test/it/org/xwiki/test/ui/EditWYSIWYGTest.java-    public void testBackForwardCache()
./src/test/it/org/xwiki/test/ui/EditWYSIWYGTest.java-    public void testPreserveUnsavedRichContentAgainstRefresh()
./src/test/it/org/xwiki/test/ui/EditWYSIWYGTest.java-    public void testPreserveUnsavedSourceAgainstRefresh()
./src/test/it/org/xwiki/test/ui/EditWYSIWYGTest.java-    public void testPreserveSelectedEditorAgainstRefresh()
./src/test/it/org/xwiki/test/ui/EditWYSIWYGTest.java-    public void testUndoRepeatedPaste()
./src/test/it/org/xwiki/test/ui/invitation/InvitationTest.java-    public void testUnpermittedUserCannotSendToMultipleAddresses() throws Exception
./src/test/it/org/xwiki/test/ui/invitation/InvitationTest.java-    public void testSpamReporting() throws Exception
./src/test/it/org/xwiki/test/ui/invitation/InvitationTest.java-    public void testDeclineInvitation() throws Exception
./src/test/it/org/xwiki/test/ui/invitation/InvitationTest.java-    public void testAcceptInvitation() throws Exception
./src/test/it/org/xwiki/test/ui/invitation/InvitationTest.java-    public void testAcceptInvitationToClosedWiki() throws Exception
./src/test/it/org/xwiki/test/ui/invitation/InvitationTest.java-    public void testCancelInvitation() throws Exception
./src/test/it/org/xwiki/test/ui/invitation/InvitationTest.java-    public void testSendManyToOneAddress() throws Exception
./src/test/it/org/xwiki/test/ui/KeyboardShortcutsTest.java-    public void testKeyboardShortcuts()
./src/test/it/org/xwiki/test/ui/LoginTest.java-    public void testLoginLogoutAsAdmin()
./src/test/it/org/xwiki/test/ui/LoginTest.java-    public void testLoginWithInvalidCredentials()
./src/test/it/org/xwiki/test/ui/LoginTest.java-    public void testLoginWithInvalidUsername()
./src/test/it/org/xwiki/test/ui/LoginTest.java-    public void testRedirectPreservesPOSTParameters()
./src/test/it/org/xwiki/test/ui/LoginTest.java-    public void testCorrectUrlIsAccessedAfterLogin()
./src/test/it/org/xwiki/test/ui/LoginTest.java-    public void testDataIsPreservedAfterLogin()
./src/test/it/org/xwiki/test/ui/panels/NewPagePanelTest.java-    public void testCreatePageFromPanel()
./src/test/it/org/xwiki/test/ui/RegisterTest.java-    public void testRegisterJohnSmith()
./src/test/it/org/xwiki/test/ui/RegisterTest.java-    public void testRegisterExistingUser()
./src/test/it/org/xwiki/test/ui/RegisterTest.java-    public void testRegisterPasswordTooShort()
./src/test/it/org/xwiki/test/ui/RegisterTest.java-    public void testRegisterDifferentPasswords()
./src/test/it/org/xwiki/test/ui/RegisterTest.java-    public void testRegisterEmptyPassword()
./src/test/it/org/xwiki/test/ui/RegisterTest.java-    public void testRegisterEmptyUserName()
./src/test/it/org/xwiki/test/ui/RegisterTest.java-    public void testRegisterInvalidEmail()
./src/test/it/org/xwiki/test/ui/scheduler/SchedulerTest.java-    public void testSchedulerJobDefaultEditMode()
./src/test/it/org/xwiki/test/ui/scheduler/SchedulerTest.java-    public void testJobActions()
./src/test/it/org/xwiki/test/ui/SectionTest.java-    public void testSectionEditInEditorWhenSyntax10()
./src/test/it/org/xwiki/test/ui/SectionTest.java-    public void testSectionEditInWikiEditorWhenSyntax2x()
./src/test/it/org/xwiki/test/ui/SectionTest.java-    public void testSectionSaveDoesNotOverwriteTheWholeContentWhenSyntax10()
./src/test/it/org/xwiki/test/ui/SectionTest.java-    public void testSectionSaveDoesNotOverwriteTheWholeContentWhenSyntax20()
./src/test/it/org/xwiki/test/ui/tag/AddRemoveTagsTest.java-    public void testAddRemoveTag()
./src/test/it/org/xwiki/test/ui/tag/AddRemoveTagsTest.java-    public void testCancelAddTag()
./src/test/it/org/xwiki/test/ui/tag/AddRemoveTagsTest.java-    public void testAddManyRemoveOneTag()
./src/test/it/org/xwiki/test/ui/tag/AddRemoveTagsTest.java-    public void testAddExistingTag()
./src/test/it/org/xwiki/test/ui/tag/AddRemoveTagsTest.java-    public void testAddTagContainingPipe()
./src/test/it/org/xwiki/test/ui/tag/AddRemoveTagsTest.java-    public void testStripLeadingAndTrailingSpacesFromTags()
./src/test/it/org/xwiki/test/ui/tag/AddRemoveTagsTest.java-    public void testTagCaseIsIgnored()
./src/test/it/org/xwiki/test/ui/TemplateTest.java-    public void testHelloVelocity()
./src/test/it/org/xwiki/test/ui/TemplateTest.java-    public void testCorrectTemplate()
./src/test/it/org/xwiki/test/ui/TemplateTest.java-    public void testWrongTemplate()
./src/test/it/org/xwiki/test/ui/VersionTest.java-    public void testRollbackToFirstVersion() throws Exception
./src/test/it/org/xwiki/test/ui/watchlist/AutoWatchTest.java-    public void testAutomaticWatchNewPage()
./src/test/it/org/xwiki/test/ui/watchlist/WatchThisPageAndWholeSpaceTest.java-    public void testWatchThisPageAndWholeSpace() throws Exception
./src/test/it/org/xwiki/test/ui/xe/DocumentIndexAttachmentsTabFilterTest.java-    public void testAttachmentsPane()
./src/test/it/org/xwiki/test/ui/xe/SpacesTest.java-    public void testCreateSpace()
./src/test/it/org/xwiki/test/ui/xe/SpacesTest.java-    public void testLinkToSpaceIndexWhenSpecialCharacterInSpaceName()

Issue Links

relates to

Task - A task that needs to be done. XE-1176 Exclude failing Selenium 2 tests on IE9 from running

  • Major - Major loss of function.
  • Closed - The issue is considered finished, the resolution is correct and has been pushed to production. Issues which are not closed can be reopened.

Task - A task that needs to be done. XE-1181 Exclude more failing Selenium 2 tests on IE9 from running

  • Major - Major loss of function.
  • Closed - The issue is considered finished, the resolution is correct and has been pushed to production. Issues which are not closed can be reopened.

Activity

There are no comments yet on this issue.

People

  • Assignee:
    Unassigned
    Reporter:
    Sorin Burjan
Vote (0)
Watch (1)

Dates

  • Created:
    Updated: